Skip to content

Centralize SQL benchmark matrices in bench-orchestrator - #8801

Closed
connortsui20 wants to merge 1 commit into
developfrom
codex/improve-clarity-of-pr-description
Closed

Centralize SQL benchmark matrices in bench-orchestrator#8801
connortsui20 wants to merge 1 commit into
developfrom
codex/improve-clarity-of-pr-description

Conversation

@connortsui20

@connortsui20 connortsui20 commented Jul 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Member

Closes: #4935

Motivation

SQL benchmark matrices were spread across several workflows as large JSON blocks, making target coverage difficult to compare or update consistently. This PR moves that configuration into one Python source of truth while preserving the current CI coverage.

How it works

  1. bench_orchestrator/benchmarks.py declares each benchmark, including its supported engine/format targets, scale, storage, and iterations.
  2. bench_orchestrator/matrix.py renders one named preset:
    • pr: quicker PR coverage
    • pr-full: full PR coverage
    • develop: regular develop benchmarks
    • nightly: SF=100 TPC-H
    • vortex: Vortex query benchmarks
  3. vx-bench matrix <preset> emits the compact JSON include array expected by GitHub Actions.
  4. sql-benchmarks.yml resolves that preset in a small read-only job, then uses fromJSON(...) to fan out the benchmark jobs. Each matrix entry already contains its final targets and data_formats, so the workflow no longer contains separate PR/develop target-selection logic.

Remote benchmark declarations emit only a relative dataset key. The workflow constructs the complete S3 path using the current GitHub ref and run ID, where those values are available.

Validation

  • All five rendered matrices are byte-for-byte unchanged from the previous workflow matrices.
  • 29 orchestrator tests pass, along with Ruff, basedpyright, yamllint, and actionlint.
  • The live matrix resolver and downstream Vortex benchmark both pass in GitHub Actions.

@github-actions

github-actions Bot commented Jul 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 2d4d608 1 Explore Profiling Data
Previous Runs (4)
Status Commit Job Attempt Link
🟢 Done a071922 1 Explore Profiling Data
🟢 Done 57221e0 1 Explore Profiling Data
🟢 Done 995a5b6 1 Explore Profiling Data
🟢 Done 7ee63ee 1 Explore Profiling Data

Powered by Polar Signals Cloud

chatgpt-codex-connector[bot]
chatgpt-codex-connector Bot reviewed Jul 16, 2026
View reviewed changes

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 7ee63eed84

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread bench-orchestrator/bench_orchestrator/matrix.py
@github-actions

github-actions Bot commented Jul 16, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Vortex queries 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.6%
Engines: DataFusion No clear signal (+1.5%, low confidence) · DuckDB No clear signal (+3.7%, low confidence)
Vortex (geomean): 1.045x ➖
Parquet (geomean): 1.032x ➖
Shifts: Parquet (control) +3.2% · Median polish +5.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.065x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
vortex_q00/datafusion:vortex-file-compressed 49142825 46849865 1.05
vortex_q01/datafusion:vortex-file-compressed 62030462 57358992 1.08
datafusion / parquet (1.049x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
vortex_q00/datafusion:parquet 172869787 161087352 1.07
vortex_q01/datafusion:parquet 26597856 25919796 1.03
duckdb / vortex-file-compressed (1.052x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
vortex_q00/duckdb:vortex-file-compressed 60078103 57145109 1.05
vortex_q01/duckdb:vortex-file-compressed 39183894 37215161 1.05
duckdb / parquet (1.014x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
vortex_q00/duckdb:parquet 182361655 179388646 1.02
vortex_q01/duckdb:parquet 63737173 62993485 1.01

No file size changes detected.

@codecov

codecov Bot commented Jul 16, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 81.80%. Comparing base (17f843a) to head (7ee63ee).

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@connortsui20
connortsui20 force-pushed the codex/improve-clarity-of-pr-description branch 2 times, most recently from d62ddf8 to 995a5b6 Compare July 20, 2026 15:36
@connortsui20
connortsui20 marked this pull request as draft July 20, 2026 15:47
@connortsui20 connortsui20 changed the title Add declarative SQL benchmark matrix profiles and vx-bench matrix CLI Centralize SQL benchmark matrices in bench-orchestrator Jul 20, 2026
@connortsui20
connortsui20 requested review from 0ax1, AdamGS and myrrc July 20, 2026 16:22
@connortsui20
connortsui20 marked this pull request as ready for review July 20, 2026 16:24
@connortsui20
connortsui20 force-pushed the codex/improve-clarity-of-pr-description branch from a071922 to 1865849 Compare July 23, 2026 14:44
@codspeed-hq

codspeed-hq Bot commented Jul 23, 2026 •
edited
Loading

Copy link
Copy Markdown

Merging this PR will not alter performance

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

✅ 1892 untouched benchmarks
⏩ 3 skipped benchmarks1

Comparing codex/improve-clarity-of-pr-description (2d4d608) with develop (b03f803)

Open in CodSpeed

Footnotes

  1. 3 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@connortsui20
connortsui20 force-pushed the codex/improve-clarity-of-pr-description branch from 1865849 to f6255c2 Compare July 27, 2026 13:48
@connortsui20
Centralize SQL benchmark matrices in bench-orchestrator
2d4d608 
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
connortsui20 force-pushed the codex/improve-clarity-of-pr-description branch from f6255c2 to 2d4d608 Compare July 27, 2026 13:56
@connortsui20 connortsui20 added the action/benchmark Trigger full benchmarks to run on this PR label Jul 27, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jul 27, 2026
@github-actions

github-actions Bot commented Jul 27, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Vortex (geomean): 1.053x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.053x ➖, 1↑ 3↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 🚀 99504651 117755426 0.85
polarsignals_q01/datafusion:vortex-file-compressed 269969629 278275083 0.97
polarsignals_q02/datafusion:vortex-file-compressed 22488981 21084590 1.07
polarsignals_q03/datafusion:vortex-file-compressed 283317942 263093782 1.08
polarsignals_q04/datafusion:vortex-file-compressed 🚨 10750992 9425255 1.14
polarsignals_q05/datafusion:vortex-file-compressed 🚨 16166459 14338800 1.13
polarsignals_q06/datafusion:vortex-file-compressed 21894285 20061655 1.09
polarsignals_q07/datafusion:vortex-file-compressed 🚨 15415821 12873716 1.20
polarsignals_q08/datafusion:vortex-file-compressed 396436861 378740080 1.05
polarsignals_q09/datafusion:vortex-file-compressed 10527398 10380093 1.01

No file size changes detected.

@github-actions

github-actions Bot commented Jul 27, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.6%
Engines: DataFusion No clear signal (-0.9%, environment too noisy confidence) · DuckDB No clear signal (-2.6%, environment too noisy confidence)
Vortex (geomean): 0.908x ➖
Parquet (geomean): 0.928x ➖
Shifts: Parquet (control) -7.2% · Median polish -9.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.898x ✅, 12↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 50464499 54491910 0.93
tpch_q02/datafusion:vortex-file-compressed 21658891 22876184 0.95
tpch_q03/datafusion:vortex-file-compressed 🚀 30531584 34549517 0.88
tpch_q04/datafusion:vortex-file-compressed 18369635 20278364 0.91
tpch_q05/datafusion:vortex-file-compressed 🚀 43758761 50018503 0.87
tpch_q06/datafusion:vortex-file-compressed 🚀 9430476 11046992 0.85
tpch_q07/datafusion:vortex-file-compressed 🚀 50430203 57069021 0.88
tpch_q08/datafusion:vortex-file-compressed 🚀 36406809 41849885 0.87
tpch_q09/datafusion:vortex-file-compressed 🚀 48021053 54184713 0.89
tpch_q10/datafusion:vortex-file-compressed 31670005 34858958 0.91
tpch_q11/datafusion:vortex-file-compressed 🚀 15548127 17379349 0.89
tpch_q12/datafusion:vortex-file-compressed 22683124 25176812 0.90
tpch_q13/datafusion:vortex-file-compressed 24725390 26594045 0.93
tpch_q14/datafusion:vortex-file-compressed 🚀 14154614 15897005 0.89
tpch_q15/datafusion:vortex-file-compressed 22284204 24390837 0.91
tpch_q16/datafusion:vortex-file-compressed 18842000 20797148 0.91
tpch_q17/datafusion:vortex-file-compressed 🚀 63091509 70575873 0.89
tpch_q18/datafusion:vortex-file-compressed 🚀 70777773 79462679 0.89
tpch_q19/datafusion:vortex-file-compressed 19209469 21310624 0.90
tpch_q20/datafusion:vortex-file-compressed 🚀 28257154 31430517 0.90
tpch_q21/datafusion:vortex-file-compressed 65850029 71843490 0.92
tpch_q22/datafusion:vortex-file-compressed 🚀 11465690 12826477 0.89
datafusion / vortex-compact (0.913x ➖, 5↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 59649761 66109805 0.90
tpch_q02/datafusion:vortex-compact 24130805 26541632 0.91
tpch_q03/datafusion:vortex-compact 32984824 34888960 0.95
tpch_q04/datafusion:vortex-compact 23214419 25645422 0.91
tpch_q05/datafusion:vortex-compact 🚀 45900949 51619145 0.89
tpch_q06/datafusion:vortex-compact 11758515 12864778 0.91
tpch_q07/datafusion:vortex-compact 54864395 60912247 0.90
tpch_q08/datafusion:vortex-compact 40554369 44434715 0.91
tpch_q09/datafusion:vortex-compact 54716060 58678810 0.93
tpch_q10/datafusion:vortex-compact 36714706 40754938 0.90
tpch_q11/datafusion:vortex-compact 17003637 18620646 0.91
tpch_q12/datafusion:vortex-compact 31197503 32707494 0.95
tpch_q13/datafusion:vortex-compact 30731957 31917454 0.96
tpch_q14/datafusion:vortex-compact 17592893 19171093 0.92
tpch_q15/datafusion:vortex-compact 28810499 30937721 0.93
tpch_q16/datafusion:vortex-compact 22144229 23788151 0.93
tpch_q17/datafusion:vortex-compact 🚀 63910401 74071789 0.86
tpch_q18/datafusion:vortex-compact 76879311 84966277 0.90
tpch_q19/datafusion:vortex-compact 38406958 40234683 0.95
tpch_q20/datafusion:vortex-compact 🚀 33932190 38824913 0.87
tpch_q21/datafusion:vortex-compact 🚀 75082724 84451956 0.89
tpch_q22/datafusion:vortex-compact 🚀 12964363 14651177 0.88
datafusion / parquet (0.914x ➖, 9↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 100575027 127380981 0.79
tpch_q02/datafusion:parquet 🚀 57173161 64340378 0.89
tpch_q03/datafusion:parquet 71430658 74793524 0.96
tpch_q04/datafusion:parquet 47813880 49368734 0.97
tpch_q05/datafusion:parquet 🚀 90992188 102939094 0.88
tpch_q06/datafusion:parquet 42521797 44312574 0.96
tpch_q07/datafusion:parquet 🚀 94618335 106239269 0.89
tpch_q08/datafusion:parquet 🚀 90558642 102453953 0.88
tpch_q09/datafusion:parquet 118046093 127116259 0.93
tpch_q10/datafusion:parquet 115088839 119006992 0.97
tpch_q11/datafusion:parquet 39965815 44024017 0.91
tpch_q12/datafusion:parquet 82625451 80224765 1.03
tpch_q13/datafusion:parquet 188575816 205717416 0.92
tpch_q14/datafusion:parquet 46187835 48263368 0.96
tpch_q15/datafusion:parquet 59429603 64489161 0.92
tpch_q16/datafusion:parquet 🚀 39903436 46854413 0.85
tpch_q17/datafusion:parquet 🚀 136906105 157721709 0.87
tpch_q18/datafusion:parquet 🚀 143533645 163893085 0.88
tpch_q19/datafusion:parquet 71564964 77028559 0.93
tpch_q20/datafusion:parquet 🚀 65206140 75965827 0.86
tpch_q21/datafusion:parquet 140684131 141698878 0.99
tpch_q22/datafusion:parquet 43232878 47220591 0.92
duckdb / vortex-file-compressed (0.908x ➖, 10↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 28217042 28828876 0.98
tpch_q02/duckdb:vortex-file-compressed 24572172 26897523 0.91
tpch_q03/duckdb:vortex-file-compressed 31438895 34239574 0.92
tpch_q04/duckdb:vortex-file-compressed 27598660 29732321 0.93
tpch_q05/duckdb:vortex-file-compressed 🚀 34701899 39597786 0.88
tpch_q06/duckdb:vortex-file-compressed 🚀 7912185 9254640 0.85
tpch_q07/duckdb:vortex-file-compressed 🚀 33079310 37048888 0.89
tpch_q08/duckdb:vortex-file-compressed 🚀 37761133 42064765 0.90
tpch_q09/duckdb:vortex-file-compressed 🚀 54992601 61657773 0.89
tpch_q10/duckdb:vortex-file-compressed 40310408 43771794 0.92
tpch_q11/duckdb:vortex-file-compressed 13615363 14153441 0.96
tpch_q12/duckdb:vortex-file-compressed 23008969 24304785 0.95
tpch_q13/duckdb:vortex-file-compressed 38804905 42943868 0.90
tpch_q14/duckdb:vortex-file-compressed 19765039 20919185 0.94
tpch_q15/duckdb:vortex-file-compressed 🚀 15727913 17622414 0.89
tpch_q16/duckdb:vortex-file-compressed 27160709 28880804 0.94
tpch_q17/duckdb:vortex-file-compressed 23235416 25461317 0.91
tpch_q18/duckdb:vortex-file-compressed 50748213 56300722 0.90
tpch_q19/duckdb:vortex-file-compressed 🚀 26075193 29211876 0.89
tpch_q20/duckdb:vortex-file-compressed 🚀 30450008 34423791 0.88
tpch_q21/duckdb:vortex-file-compressed 🚀 96681635 110315250 0.88
tpch_q22/duckdb:vortex-file-compressed 🚀 16631124 19258941 0.86
duckdb / vortex-compact (0.913x ➖, 8↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38642624 40010870 0.97
tpch_q02/duckdb:vortex-compact 31989799 33695011 0.95
tpch_q03/duckdb:vortex-compact 34200352 37064224 0.92
tpch_q04/duckdb:vortex-compact 33534873 36207415 0.93
tpch_q05/duckdb:vortex-compact 39426971 43506240 0.91
tpch_q06/duckdb:vortex-compact 🚀 10168203 11644556 0.87
tpch_q07/duckdb:vortex-compact 42426937 44346882 0.96
tpch_q08/duckdb:vortex-compact 46092546 49590887 0.93
tpch_q09/duckdb:vortex-compact 65758146 71499818 0.92
tpch_q10/duckdb:vortex-compact 46984646 48744655 0.96
tpch_q11/duckdb:vortex-compact 15713361 16865255 0.93
tpch_q12/duckdb:vortex-compact 31744321 34139767 0.93
tpch_q13/duckdb:vortex-compact 44582398 48524483 0.92
tpch_q14/duckdb:vortex-compact 🚀 23060293 25784922 0.89
tpch_q15/duckdb:vortex-compact 🚀 19030887 21477357 0.89
tpch_q16/duckdb:vortex-compact 28857903 31819806 0.91
tpch_q17/duckdb:vortex-compact 🚀 27749438 30947217 0.90
tpch_q18/duckdb:vortex-compact 59065660 61856657 0.95
tpch_q19/duckdb:vortex-compact 🚀 28450208 32059499 0.89
tpch_q20/duckdb:vortex-compact 🚀 37024691 42653003 0.87
tpch_q21/duckdb:vortex-compact 🚀 112875293 127736051 0.88
tpch_q22/duckdb:vortex-compact 🚀 16861673 20444728 0.82
duckdb / parquet (0.942x ➖, 5↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 78139119 79969529 0.98
tpch_q02/duckdb:parquet 39505198 42907665 0.92
tpch_q03/duckdb:parquet 71019670 74385504 0.95
tpch_q04/duckdb:parquet 50085532 52946201 0.95
tpch_q05/duckdb:parquet 🚀 68881513 81952755 0.84
tpch_q06/duckdb:parquet 22503700 23937840 0.94
tpch_q07/duckdb:parquet 78839216 77963489 1.01
tpch_q08/duckdb:parquet 89884432 87043839 1.03
tpch_q09/duckdb:parquet 🚀 137121989 158503911 0.87
tpch_q10/duckdb:parquet 138469572 133147848 1.04
tpch_q11/duckdb:parquet 22829448 24011525 0.95
tpch_q12/duckdb:parquet 🚀 52931116 59139187 0.90
tpch_q13/duckdb:parquet 257272633 279982509 0.92
tpch_q14/duckdb:parquet 50913220 54037713 0.94
tpch_q15/duckdb:parquet 26498621 27276346 0.97
tpch_q16/duckdb:parquet 58545113 62602644 0.94
tpch_q17/duckdb:parquet 55857907 59066353 0.95
tpch_q18/duckdb:parquet 122795785 126546451 0.97
tpch_q19/duckdb:parquet 🚀 72393132 81590051 0.89
tpch_q20/duckdb:parquet 65813108 68199748 0.97
tpch_q21/duckdb:parquet 🚀 175983907 199302842 0.88
tpch_q22/duckdb:parquet 54982791 57565782 0.96
duckdb / duckdb (0.931x ➖, 3↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 17937404 18750405 0.96
tpch_q02/duckdb:duckdb 🚀 14375274 16059077 0.90
tpch_q03/duckdb:duckdb 🚀 22084814 24812118 0.89
tpch_q04/duckdb:duckdb 22098462 24338897 0.91
tpch_q05/duckdb:duckdb 23621797 24712612 0.96
tpch_q06/duckdb:duckdb 7152879 7702812 0.93
tpch_q07/duckdb:duckdb 25316831 27999978 0.90
tpch_q08/duckdb:duckdb 24322370 26644952 0.91
tpch_q09/duckdb:duckdb 🚀 56766240 66232885 0.86
tpch_q10/duckdb:duckdb 49910279 54184833 0.92
tpch_q11/duckdb:duckdb 7137478 7302538 0.98
tpch_q12/duckdb:duckdb 18204904 18991521 0.96
tpch_q13/duckdb:duckdb 39789394 42653982 0.93
tpch_q14/duckdb:duckdb 21376327 23208989 0.92
tpch_q15/duckdb:duckdb 13867200 14534769 0.95
tpch_q16/duckdb:duckdb 25968269 28174897 0.92
tpch_q17/duckdb:duckdb 15978724 17011023 0.94
tpch_q18/duckdb:duckdb 40982405 42251326 0.97
tpch_q19/duckdb:duckdb 30879146 33833047 0.91
tpch_q20/duckdb:duckdb 25352226 26496251 0.96
tpch_q21/duckdb:duckdb 62081472 66184250 0.94
tpch_q22/duckdb:duckdb 26498758 27130914 0.98

No file size changes detected.

@github-actions

github-actions Bot commented Jul 27, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.3%
Engines: DataFusion No clear signal (+1.5%, environment too noisy confidence) · DuckDB No clear signal (+1.1%, low confidence)
Vortex (geomean): 1.010x ➖
Parquet (geomean): 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.027x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5531973 5449906 1.02
fineweb_q01/datafusion:vortex-file-compressed 33781785 33851221 1.00
fineweb_q02/datafusion:vortex-file-compressed 39096588 35740501 1.09
fineweb_q03/datafusion:vortex-file-compressed 60814086 57611824 1.06
fineweb_q04/datafusion:vortex-file-compressed 276663524 265358520 1.04
fineweb_q05/datafusion:vortex-file-compressed 201648572 198954470 1.01
fineweb_q06/datafusion:vortex-file-compressed 51111214 49831938 1.03
fineweb_q07/datafusion:vortex-file-compressed 58682441 57698582 1.02
fineweb_q08/datafusion:vortex-file-compressed 20777751 21040457 0.99
datafusion / vortex-compact (0.993x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5930414 5660696 1.05
fineweb_q01/datafusion:vortex-compact 99514875 102101991 0.97
fineweb_q02/datafusion:vortex-compact 110771744 111703993 0.99
fineweb_q03/datafusion:vortex-compact 883145885 906480691 0.97
fineweb_q04/datafusion:vortex-compact 943954781 964839302 0.98
fineweb_q05/datafusion:vortex-compact 847804182 862199227 0.98
fineweb_q06/datafusion:vortex-compact 478526976 481365016 0.99
fineweb_q07/datafusion:vortex-compact 496655433 503317431 0.99
fineweb_q08/datafusion:vortex-compact 20371573 20135212 1.01
datafusion / parquet (0.995x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 7831228 7241875 1.08
fineweb_q01/datafusion:parquet 314992346 326633890 0.96
fineweb_q02/datafusion:parquet 320305737 324230661 0.99
fineweb_q03/datafusion:parquet 324605813 298423517 1.09
fineweb_q04/datafusion:parquet 329884534 340379888 0.97
fineweb_q05/datafusion:parquet 317848645 347325257 0.92
fineweb_q06/datafusion:parquet 312754004 312911700 1.00
fineweb_q07/datafusion:parquet 306957751 313748240 0.98
fineweb_q08/datafusion:parquet 307141467 311427615 0.99
duckdb / vortex-file-compressed (1.028x ➖, 0↑ 1↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3497696 3347223 1.04
fineweb_q01/duckdb:vortex-file-compressed 35531795 35948127 0.99
fineweb_q02/duckdb:vortex-file-compressed 41342505 43509871 0.95
fineweb_q03/duckdb:vortex-file-compressed 112670894 107936708 1.04
fineweb_q04/duckdb:vortex-file-compressed 280699842 260822643 1.08
fineweb_q05/duckdb:vortex-file-compressed 211402306 203610410 1.04
fineweb_q06/duckdb:vortex-file-compressed 55815874 57315868 0.97
fineweb_q07/duckdb:vortex-file-compressed 🚨 60356167 54610905 1.11
fineweb_q08/duckdb:vortex-file-compressed 23949062 23010525 1.04
duckdb / vortex-compact (0.993x ➖, 0↑ 1↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 3470567 3593962 0.97
fineweb_q01/duckdb:vortex-compact 112439288 113989124 0.99
fineweb_q02/duckdb:vortex-compact 🚨 132655635 116198546 1.14
fineweb_q03/duckdb:vortex-compact 881877274 894467502 0.99
fineweb_q04/duckdb:vortex-compact 930414877 961920938 0.97
fineweb_q05/duckdb:vortex-compact 853141824 858488373 0.99
fineweb_q06/duckdb:vortex-compact 481510970 491844949 0.98
fineweb_q07/duckdb:vortex-compact 504712542 509944013 0.99
fineweb_q08/duckdb:vortex-compact 21302578 22729402 0.94
duckdb / parquet (0.999x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 34871352 34990725 1.00
fineweb_q01/duckdb:parquet 98632186 97712963 1.01
fineweb_q02/duckdb:parquet 95919398 97014178 0.99
fineweb_q03/duckdb:parquet 333603263 336763045 0.99
fineweb_q04/duckdb:parquet 463415999 463546415 1.00
fineweb_q05/duckdb:parquet 428183512 434168206 0.99
fineweb_q06/duckdb:parquet 217371779 215644927 1.01
fineweb_q07/duckdb:parquet 231956118 228312002 1.02
fineweb_q08/duckdb:parquet 42446962 42481157 1.00

No file size changes detected.

@github-actions

github-actions Bot commented Jul 27, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (-1.3%, low confidence)
Vortex (geomean): 0.940x ➖
Parquet (geomean): 0.946x ➖
Shifts: Parquet (control) -5.4% · Median polish -5.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.920x ➖, 26↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 21799377 23403961 0.93
tpcds_q02/datafusion:vortex-file-compressed 41771867 44326596 0.94
tpcds_q03/datafusion:vortex-file-compressed 🚀 14159018 15819427 0.90
tpcds_q04/datafusion:vortex-file-compressed 219771220 232104172 0.95
tpcds_q05/datafusion:vortex-file-compressed 42764768 45190098 0.95
tpcds_q06/datafusion:vortex-file-compressed 22202024 23149263 0.96
tpcds_q07/datafusion:vortex-file-compressed 41101151 44179772 0.93
tpcds_q08/datafusion:vortex-file-compressed 29531595 30571206 0.97
tpcds_q09/datafusion:vortex-file-compressed 30447287 32308704 0.94
tpcds_q10/datafusion:vortex-file-compressed 🚀 35249811 39492390 0.89
tpcds_q11/datafusion:vortex-file-compressed 128637337 133795038 0.96
tpcds_q12/datafusion:vortex-file-compressed 17235269 17688729 0.97
tpcds_q13/datafusion:vortex-file-compressed 42253846 45110788 0.94
tpcds_q14/datafusion:vortex-file-compressed 154449791 162911619 0.95
tpcds_q15/datafusion:vortex-file-compressed 25876365 28003801 0.92
tpcds_q16/datafusion:vortex-file-compressed 🚀 22019043 25457101 0.86
tpcds_q17/datafusion:vortex-file-compressed 56902498 62977269 0.90
tpcds_q18/datafusion:vortex-file-compressed 58995215 62435595 0.94
tpcds_q19/datafusion:vortex-file-compressed 20886292 22267062 0.94
tpcds_q20/datafusion:vortex-file-compressed 19294506 20515735 0.94
tpcds_q21/datafusion:vortex-file-compressed 🚀 35453850 39888798 0.89
tpcds_q22/datafusion:vortex-file-compressed 🚀 117891013 159087351 0.74
tpcds_q23/datafusion:vortex-file-compressed 🚀 151610591 171392204 0.88
tpcds_q24/datafusion:vortex-file-compressed 80995670 89366678 0.91
tpcds_q25/datafusion:vortex-file-compressed 🚀 59275062 66239919 0.89
tpcds_q26/datafusion:vortex-file-compressed 🚀 28846134 32142769 0.90
tpcds_q27/datafusion:vortex-file-compressed 92816199 100338651 0.93
tpcds_q28/datafusion:vortex-file-compressed 31465902 34220363 0.92
tpcds_q29/datafusion:vortex-file-compressed 🚀 55729979 62831887 0.89
tpcds_q30/datafusion:vortex-file-compressed 🚀 22739402 25713025 0.88
tpcds_q31/datafusion:vortex-file-compressed 🚀 67524332 75191845 0.90
tpcds_q32/datafusion:vortex-file-compressed 17199144 18913139 0.91
tpcds_q33/datafusion:vortex-file-compressed 27937501 30081712 0.93
tpcds_q34/datafusion:vortex-file-compressed 🚀 24070478 28094445 0.86
tpcds_q35/datafusion:vortex-file-compressed 🚀 42511472 47546578 0.89
tpcds_q36/datafusion:vortex-file-compressed 60300563 62382030 0.97
tpcds_q37/datafusion:vortex-file-compressed 🚀 17087881 19487351 0.88
tpcds_q38/datafusion:vortex-file-compressed 36971387 39901020 0.93
tpcds_q39/datafusion:vortex-file-compressed 🚀 102195144 117206411 0.87
tpcds_q40/datafusion:vortex-file-compressed 30823104 31371630 0.98
tpcds_q41/datafusion:vortex-file-compressed 🚀 19179028 22776520 0.84
tpcds_q42/datafusion:vortex-file-compressed 🚀 12454702 14401771 0.86
tpcds_q43/datafusion:vortex-file-compressed 17868366 19343752 0.92
tpcds_q44/datafusion:vortex-file-compressed 29383761 31399056 0.94
tpcds_q45/datafusion:vortex-file-compressed 🚀 24395141 27295517 0.89
tpcds_q46/datafusion:vortex-file-compressed 34696043 37166782 0.93
tpcds_q47/datafusion:vortex-file-compressed 132529852 146575083 0.90
tpcds_q48/datafusion:vortex-file-compressed 🚀 34821728 40168317 0.87
tpcds_q49/datafusion:vortex-file-compressed 55273613 61251636 0.90
tpcds_q50/datafusion:vortex-file-compressed 38825024 41977985 0.92
tpcds_q51/datafusion:vortex-file-compressed 85627751 92304965 0.93
tpcds_q52/datafusion:vortex-file-compressed 13023699 14341893 0.91
tpcds_q53/datafusion:vortex-file-compressed 20782063 22229825 0.93
tpcds_q54/datafusion:vortex-file-compressed 32255400 33710512 0.96
tpcds_q55/datafusion:vortex-file-compressed 12741291 13557849 0.94
tpcds_q56/datafusion:vortex-file-compressed 28832816 31477112 0.92
tpcds_q57/datafusion:vortex-file-compressed 89464029 96186606 0.93
tpcds_q58/datafusion:vortex-file-compressed 50555779 54655495 0.92
tpcds_q59/datafusion:vortex-file-compressed 58889769 61271539 0.96
tpcds_q60/datafusion:vortex-file-compressed 27959833 30892253 0.91
tpcds_q61/datafusion:vortex-file-compressed 38124572 41680416 0.91
tpcds_q62/datafusion:vortex-file-compressed 20816395 22707172 0.92
tpcds_q63/datafusion:vortex-file-compressed 20924689 22876459 0.91
tpcds_q64/datafusion:vortex-file-compressed 🚀 361132354 419097792 0.86
tpcds_q65/datafusion:vortex-file-compressed 49737853 51937432 0.96
tpcds_q66/datafusion:vortex-file-compressed 71918865 72327418 0.99
tpcds_q67/datafusion:vortex-file-compressed 149651507 157474754 0.95
tpcds_q68/datafusion:vortex-file-compressed 33207859 34928775 0.95
tpcds_q69/datafusion:vortex-file-compressed 33918304 36875945 0.92
tpcds_q70/datafusion:vortex-file-compressed 92454023 99291534 0.93
tpcds_q71/datafusion:vortex-file-compressed 22289062 23251570 0.96
tpcds_q72/datafusion:vortex-file-compressed 2077447890 2258622772 0.92
tpcds_q73/datafusion:vortex-file-compressed 🚀 22804540 25938505 0.88
tpcds_q74/datafusion:vortex-file-compressed 75444659 83464718 0.90
tpcds_q75/datafusion:vortex-file-compressed 111918466 112484225 0.99
tpcds_q76/datafusion:vortex-file-compressed 27508413 29809465 0.92
tpcds_q77/datafusion:vortex-file-compressed 34773995 37277274 0.93
tpcds_q78/datafusion:vortex-file-compressed 107845793 114975912 0.94
tpcds_q79/datafusion:vortex-file-compressed 27807971 30107158 0.92
tpcds_q80/datafusion:vortex-file-compressed 83560552 91968224 0.91
tpcds_q81/datafusion:vortex-file-compressed 24084546 25389077 0.95
tpcds_q82/datafusion:vortex-file-compressed 20209111 21491570 0.94
tpcds_q83/datafusion:vortex-file-compressed 34153229 37056251 0.92
tpcds_q84/datafusion:vortex-file-compressed 12132264 13046281 0.93
tpcds_q85/datafusion:vortex-file-compressed 83521887 92551916 0.90
tpcds_q86/datafusion:vortex-file-compressed 🚀 13980018 16611713 0.84
tpcds_q87/datafusion:vortex-file-compressed 38976547 40777951 0.96
tpcds_q88/datafusion:vortex-file-compressed 55018824 55983566 0.98
tpcds_q89/datafusion:vortex-file-compressed 🚀 24422591 27331477 0.89
tpcds_q90/datafusion:vortex-file-compressed 13251664 13930487 0.95
tpcds_q91/datafusion:vortex-file-compressed 🚀 17066655 20327804 0.84
tpcds_q92/datafusion:vortex-file-compressed 🚀 14338221 17211296 0.83
tpcds_q93/datafusion:vortex-file-compressed 30496755 32239966 0.95
tpcds_q94/datafusion:vortex-file-compressed 19174805 20671589 0.93
tpcds_q95/datafusion:vortex-file-compressed 59214282 56386216 1.05
tpcds_q96/datafusion:vortex-file-compressed 12711065 12836597 0.99
tpcds_q97/datafusion:vortex-file-compressed 27479994 28543144 0.96
tpcds_q98/datafusion:vortex-file-compressed 🚀 22785571 25749090 0.88
tpcds_q99/datafusion:vortex-file-compressed 24766377 26168622 0.95
datafusion / vortex-compact (0.940x ➖, 9↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 22122885 24363648 0.91
tpcds_q02/datafusion:vortex-compact 🚀 49764985 55387470 0.90
tpcds_q03/datafusion:vortex-compact 19744436 20076631 0.98
tpcds_q04/datafusion:vortex-compact 260781392 276495663 0.94
tpcds_q05/datafusion:vortex-compact 49096095 51456851 0.95
tpcds_q06/datafusion:vortex-compact 29578548 32332619 0.91
tpcds_q07/datafusion:vortex-compact 61442189 63072237 0.97
tpcds_q08/datafusion:vortex-compact 40153088 42092404 0.95
tpcds_q09/datafusion:vortex-compact 52921647 57048046 0.93
tpcds_q10/datafusion:vortex-compact 53763195 56839318 0.95
tpcds_q11/datafusion:vortex-compact 148622914 160950907 0.92
tpcds_q12/datafusion:vortex-compact 🚀 21315090 24985731 0.85
tpcds_q13/datafusion:vortex-compact 141116079 140080689 1.01
tpcds_q14/datafusion:vortex-compact 181270135 198013474 0.92
tpcds_q15/datafusion:vortex-compact 🚀 28635259 32317515 0.89
tpcds_q16/datafusion:vortex-compact 🚀 27639129 30762346 0.90
tpcds_q17/datafusion:vortex-compact 96165185 103147931 0.93
tpcds_q18/datafusion:vortex-compact 69172332 75039987 0.92
tpcds_q19/datafusion:vortex-compact 34097423 36657581 0.93
tpcds_q20/datafusion:vortex-compact 🚀 23405996 26770706 0.87
tpcds_q21/datafusion:vortex-compact 41012468 44459306 0.92
tpcds_q22/datafusion:vortex-compact 129239414 139281701 0.93
tpcds_q23/datafusion:vortex-compact 🚀 171180995 197318146 0.87
tpcds_q24/datafusion:vortex-compact 106392114 116033666 0.92
tpcds_q25/datafusion:vortex-compact 79544931 85871927 0.93
tpcds_q26/datafusion:vortex-compact 41609855 44839254 0.93
tpcds_q27/datafusion:vortex-compact 133075076 140193340 0.95
tpcds_q28/datafusion:vortex-compact 85581526 90436209 0.95
tpcds_q29/datafusion:vortex-compact 76852522 81066850 0.95
tpcds_q30/datafusion:vortex-compact 27416565 29635736 0.93
tpcds_q31/datafusion:vortex-compact 98696260 104644795 0.94
tpcds_q32/datafusion:vortex-compact 21504306 22710376 0.95
tpcds_q33/datafusion:vortex-compact 38047038 39777508 0.96
tpcds_q34/datafusion:vortex-compact 40633003 44531281 0.91
tpcds_q35/datafusion:vortex-compact 56327974 59937350 0.94
tpcds_q36/datafusion:vortex-compact 79279631 79837413 0.99
tpcds_q37/datafusion:vortex-compact 25095094 26216576 0.96
tpcds_q38/datafusion:vortex-compact 49446244 52660293 0.94
tpcds_q39/datafusion:vortex-compact 115949549 128700908 0.90
tpcds_q40/datafusion:vortex-compact 31807648 35085268 0.91
tpcds_q41/datafusion:vortex-compact 🚀 20884749 25300943 0.83
tpcds_q42/datafusion:vortex-compact 18788527 19802841 0.95
tpcds_q43/datafusion:vortex-compact 25407586 26802709 0.95
tpcds_q44/datafusion:vortex-compact 48730602 52784952 0.92
tpcds_q45/datafusion:vortex-compact 30518038 31934422 0.96
tpcds_q46/datafusion:vortex-compact 54484779 56744752 0.96
tpcds_q47/datafusion:vortex-compact 152482369 167261221 0.91
tpcds_q48/datafusion:vortex-compact 98370188 105695844 0.93
tpcds_q49/datafusion:vortex-compact 75995456 78358654 0.97
tpcds_q50/datafusion:vortex-compact 52791369 54643437 0.97
tpcds_q51/datafusion:vortex-compact 92486929 96963498 0.95
tpcds_q52/datafusion:vortex-compact 19014057 21004016 0.91
tpcds_q53/datafusion:vortex-compact 29270064 30862246 0.95
tpcds_q54/datafusion:vortex-compact 44140426 45695660 0.97
tpcds_q55/datafusion:vortex-compact 18077942 18980345 0.95
tpcds_q56/datafusion:vortex-compact 39160195 41230271 0.95
tpcds_q57/datafusion:vortex-compact 99024420 106544696 0.93
tpcds_q58/datafusion:vortex-compact 58910765 62978199 0.94
tpcds_q59/datafusion:vortex-compact 72785642 76662845 0.95
tpcds_q60/datafusion:vortex-compact 39933617 41746768 0.96
tpcds_q61/datafusion:vortex-compact 57559432 60152417 0.96
tpcds_q62/datafusion:vortex-compact 22675088 23788265 0.95
tpcds_q63/datafusion:vortex-compact 29399411 31371388 0.94
tpcds_q64/datafusion:vortex-compact 447661224 488266194 0.92
tpcds_q65/datafusion:vortex-compact 66175016 67769021 0.98
tpcds_q66/datafusion:vortex-compact 72713899 73712608 0.99
tpcds_q67/datafusion:vortex-compact 159103225 171697354 0.93
tpcds_q68/datafusion:vortex-compact 53598201 54775474 0.98
tpcds_q69/datafusion:vortex-compact 49716388 53128406 0.94
tpcds_q70/datafusion:vortex-compact 117043939 116337378 1.01
tpcds_q71/datafusion:vortex-compact 32595325 33848626 0.96
tpcds_q72/datafusion:vortex-compact 2090881376 2290555072 0.91
tpcds_q73/datafusion:vortex-compact 39323414 41641464 0.94
tpcds_q74/datafusion:vortex-compact 93190864 99801259 0.93
tpcds_q75/datafusion:vortex-compact 132076742 135731505 0.97
tpcds_q76/datafusion:vortex-compact 37251420 38682133 0.96
tpcds_q77/datafusion:vortex-compact 47342128 49207884 0.96
tpcds_q78/datafusion:vortex-compact 127117034 132371444 0.96
tpcds_q79/datafusion:vortex-compact 47927427 50361576 0.95
tpcds_q80/datafusion:vortex-compact 99802027 103545783 0.96
tpcds_q81/datafusion:vortex-compact 27317347 27741083 0.98
tpcds_q82/datafusion:vortex-compact 25649969 27636877 0.93
tpcds_q83/datafusion:vortex-compact 34807320 37869319 0.92
tpcds_q84/datafusion:vortex-compact 🚀 13233788 15864616 0.83
tpcds_q85/datafusion:vortex-compact 143676544 136971156 1.05
tpcds_q86/datafusion:vortex-compact 15815693 17243009 0.92
tpcds_q87/datafusion:vortex-compact 🚀 47633865 53790042 0.89
tpcds_q88/datafusion:vortex-compact 112223767 113629162 0.99
tpcds_q89/datafusion:vortex-compact 32665422 33907687 0.96
tpcds_q90/datafusion:vortex-compact 15356559 16701663 0.92
tpcds_q91/datafusion:vortex-compact 36964370 38988558 0.95
tpcds_q92/datafusion:vortex-compact 18226602 19708019 0.92
tpcds_q93/datafusion:vortex-compact 40755710 42251097 0.96
tpcds_q94/datafusion:vortex-compact 24583723 26535946 0.93
tpcds_q95/datafusion:vortex-compact 59499685 61919167 0.96
tpcds_q96/datafusion:vortex-compact 21933358 23348982 0.94
tpcds_q97/datafusion:vortex-compact 37285273 37351012 1.00
tpcds_q98/datafusion:vortex-compact 33101297 33748852 0.98
tpcds_q99/datafusion:vortex-compact 27756119 28850267 0.96
datafusion / parquet (0.926x ➖, 25↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 24105768 24647898 0.98
tpcds_q02/datafusion:parquet 40822760 44125829 0.93
tpcds_q03/datafusion:parquet 14186415 15305404 0.93
tpcds_q04/datafusion:parquet 286235890 306793363 0.93
tpcds_q05/datafusion:parquet 44408690 48454000 0.92
tpcds_q06/datafusion:parquet 22791466 23492446 0.97
tpcds_q07/datafusion:parquet 79563760 86386041 0.92
tpcds_q08/datafusion:parquet 29711799 30780500 0.97
tpcds_q09/datafusion:parquet 39447126 41817158 0.94
tpcds_q10/datafusion:parquet 73972447 76683817 0.96
tpcds_q11/datafusion:parquet 156027730 162518029 0.96
tpcds_q12/datafusion:parquet 🚀 16376960 18323994 0.89
tpcds_q13/datafusion:parquet 76095060 78457390 0.97
tpcds_q14/datafusion:parquet 157336501 170058547 0.93
tpcds_q15/datafusion:parquet 22220275 23531844 0.94
tpcds_q16/datafusion:parquet 29621482 29318983 1.01
tpcds_q17/datafusion:parquet 🚀 60653048 68246089 0.89
tpcds_q18/datafusion:parquet 109285895 115219733 0.95
tpcds_q19/datafusion:parquet 23085990 23463838 0.98
tpcds_q20/datafusion:parquet 🚀 17063278 19356437 0.88
tpcds_q21/datafusion:parquet 18384269 20137174 0.91
tpcds_q22/datafusion:parquet 156577959 157568261 0.99
tpcds_q23/datafusion:parquet 155626556 155143195 1.00
tpcds_q24/datafusion:parquet 88485022 91641848 0.97
tpcds_q25/datafusion:parquet 61347160 65336030 0.94
tpcds_q26/datafusion:parquet 66389254 65938552 1.01
tpcds_q27/datafusion:parquet 134344091 149014405 0.90
tpcds_q28/datafusion:parquet 46496862 48025174 0.97
tpcds_q29/datafusion:parquet 64012802 65947821 0.97
tpcds_q30/datafusion:parquet 32690994 35556761 0.92
tpcds_q31/datafusion:parquet 63985403 70184172 0.91
tpcds_q32/datafusion:parquet 🚀 15848110 17747187 0.89
tpcds_q33/datafusion:parquet 🚀 26714077 29800462 0.90
tpcds_q34/datafusion:parquet 23094174 22981626 1.00
tpcds_q35/datafusion:parquet 70895371 77846194 0.91
tpcds_q36/datafusion:parquet 🚀 58053192 67413292 0.86
tpcds_q37/datafusion:parquet 19268276 20531070 0.94
tpcds_q38/datafusion:parquet 42459915 46445925 0.91
tpcds_q39/datafusion:parquet 🚀 73501769 83337944 0.88
tpcds_q40/datafusion:parquet 🚀 22262516 24961990 0.89
tpcds_q41/datafusion:parquet 🚀 14625135 17088086 0.86
tpcds_q42/datafusion:parquet 🚀 11879064 14096325 0.84
tpcds_q43/datafusion:parquet 17171621 18998294 0.90
tpcds_q44/datafusion:parquet 32582884 35514817 0.92
tpcds_q45/datafusion:parquet 28231516 30250350 0.93
tpcds_q46/datafusion:parquet 🚀 32202338 36452783 0.88
tpcds_q47/datafusion:parquet 🚀 127587771 143992220 0.89
tpcds_q48/datafusion:parquet 🚀 68250073 76865084 0.89
tpcds_q49/datafusion:parquet 56947690 61739295 0.92
tpcds_q50/datafusion:parquet 44939096 44457808 1.01
tpcds_q51/datafusion:parquet 86659118 92825771 0.93
tpcds_q52/datafusion:parquet 13577705 14712059 0.92
tpcds_q53/datafusion:parquet 🚀 17795721 20510266 0.87
tpcds_q54/datafusion:parquet 33376599 34932586 0.96
tpcds_q55/datafusion:parquet 12067936 12818914 0.94
tpcds_q56/datafusion:parquet 28063894 29774864 0.94
tpcds_q57/datafusion:parquet 🚀 94630579 113907094 0.83
tpcds_q58/datafusion:parquet 🚀 53111277 63504684 0.84
tpcds_q59/datafusion:parquet 62143062 65621616 0.95
tpcds_q60/datafusion:parquet 27868225 29132539 0.96
tpcds_q61/datafusion:parquet 43931301 45498596 0.97
tpcds_q62/datafusion:parquet 24893748 26553239 0.94
tpcds_q63/datafusion:parquet 17853241 19711600 0.91
tpcds_q64/datafusion:parquet 🚀 290778432 346078244 0.84
tpcds_q65/datafusion:parquet 37532706 39048272 0.96
tpcds_q66/datafusion:parquet 69925319 75599722 0.92
tpcds_q67/datafusion:parquet 🚀 141570584 163725077 0.86
tpcds_q68/datafusion:parquet 30634456 33033979 0.93
tpcds_q69/datafusion:parquet 70040246 70744196 0.99
tpcds_q70/datafusion:parquet 33306954 34755237 0.96
tpcds_q71/datafusion:parquet 23000572 24249335 0.95
tpcds_q72/datafusion:parquet 🚀 569987026 641087769 0.89
tpcds_q73/datafusion:parquet 20246806 22390691 0.90
tpcds_q74/datafusion:parquet 🚀 81233581 91233464 0.89
tpcds_q75/datafusion:parquet 104339277 112150065 0.93
tpcds_q76/datafusion:parquet 29464584 31696752 0.93
tpcds_q77/datafusion:parquet 38697798 41800387 0.93
tpcds_q78/datafusion:parquet 110427761 111790547 0.99
tpcds_q79/datafusion:parquet 26537505 28630406 0.93
tpcds_q80/datafusion:parquet 75795429 80170311 0.95
tpcds_q81/datafusion:parquet 29850384 31999982 0.93
tpcds_q82/datafusion:parquet 18868368 19178057 0.98
tpcds_q83/datafusion:parquet 40117595 42831402 0.94
tpcds_q84/datafusion:parquet 40295169 43117352 0.93
tpcds_q85/datafusion:parquet 142990168 154248619 0.93
tpcds_q86/datafusion:parquet 15851854 15740307 1.01
tpcds_q87/datafusion:parquet 🚀 43589886 50431293 0.86
tpcds_q88/datafusion:parquet 60975788 61956017 0.98
tpcds_q89/datafusion:parquet 22508586 22901433 0.98
tpcds_q90/datafusion:parquet 14271454 15794921 0.90
tpcds_q91/datafusion:parquet 🚀 56304288 64138662 0.88
tpcds_q92/datafusion:parquet 🚀 17349447 19500211 0.89
tpcds_q93/datafusion:parquet 30004777 32148851 0.93
tpcds_q94/datafusion:parquet 21417718 23750357 0.90
tpcds_q95/datafusion:parquet 59493634 64978591 0.92
tpcds_q96/datafusion:parquet 🚀 11455216 13377715 0.86
tpcds_q97/datafusion:parquet 🚀 29322731 34137561 0.86
tpcds_q98/datafusion:parquet 21780701 23881253 0.91
tpcds_q99/datafusion:parquet 25947906 28175323 0.92
duckdb / vortex-file-compressed (0.949x ➖, 8↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 23233199 24233708 0.96
tpcds_q02/duckdb:vortex-file-compressed 21657956 23332169 0.93
tpcds_q03/duckdb:vortex-file-compressed 18978821 19942357 0.95
tpcds_q04/duckdb:vortex-file-compressed 94295581 100827930 0.94
tpcds_q05/duckdb:vortex-file-compressed 34813915 35166099 0.99
tpcds_q06/duckdb:vortex-file-compressed 33236010 36755005 0.90
tpcds_q07/duckdb:vortex-file-compressed 28452003 29267960 0.97
tpcds_q08/duckdb:vortex-file-compressed 26139921 28309669 0.92
tpcds_q09/duckdb:vortex-file-compressed 16395643 15852812 1.03
tpcds_q10/duckdb:vortex-file-compressed 39558762 42157735 0.94
tpcds_q11/duckdb:vortex-file-compressed 73841268 70299207 1.05
tpcds_q12/duckdb:vortex-file-compressed 13696231 14526009 0.94
tpcds_q13/duckdb:vortex-file-compressed 35980343 35798777 1.01
tpcds_q14/duckdb:vortex-file-compressed 101662862 107598005 0.94
tpcds_q15/duckdb:vortex-file-compressed 26984044 29397179 0.92
tpcds_q16/duckdb:vortex-file-compressed 22795563 24443818 0.93
tpcds_q17/duckdb:vortex-file-compressed 47000972 51657355 0.91
tpcds_q18/duckdb:vortex-file-compressed 39541304 42283040 0.94
tpcds_q19/duckdb:vortex-file-compressed 34168239 36992360 0.92
tpcds_q20/duckdb:vortex-file-compressed 14443413 15389419 0.94
tpcds_q21/duckdb:vortex-file-compressed 16421869 17223934 0.95
tpcds_q22/duckdb:vortex-file-compressed 🚀 70840159 79073943 0.90
tpcds_q23/duckdb:vortex-file-compressed 95754398 90065172 1.06
tpcds_q24/duckdb:vortex-file-compressed 45429622 48183966 0.94
tpcds_q25/duckdb:vortex-file-compressed 35857943 37718763 0.95
tpcds_q26/duckdb:vortex-file-compressed 18420244 20079137 0.92
tpcds_q27/duckdb:vortex-file-compressed 30316705 29487119 1.03
tpcds_q28/duckdb:vortex-file-compressed 11806960 12981146 0.91
tpcds_q29/duckdb:vortex-file-compressed 45524000 49242037 0.92
tpcds_q30/duckdb:vortex-file-compressed 25900949 26096355 0.99
tpcds_q31/duckdb:vortex-file-compressed 32217691 30310772 1.06
tpcds_q32/duckdb:vortex-file-compressed 12687144 14019411 0.90
tpcds_q33/duckdb:vortex-file-compressed 25148832 27337080 0.92
tpcds_q34/duckdb:vortex-file-compressed 26944547 27783324 0.97
tpcds_q35/duckdb:vortex-file-compressed 68870106 67964088 1.01
tpcds_q36/duckdb:vortex-file-compressed 25233123 26270033 0.96
tpcds_q37/duckdb:vortex-file-compressed 19278058 19944941 0.97
tpcds_q38/duckdb:vortex-file-compressed 41638622 42763031 0.97
tpcds_q39/duckdb:vortex-file-compressed 31881379 30246487 1.05
tpcds_q40/duckdb:vortex-file-compressed 18620168 20188379 0.92
tpcds_q41/duckdb:vortex-file-compressed 11931332 12768061 0.93
tpcds_q42/duckdb:vortex-file-compressed 16074451 16803909 0.96
tpcds_q43/duckdb:vortex-file-compressed 18119926 19436286 0.93
tpcds_q44/duckdb:vortex-file-compressed 21507549 22344214 0.96
tpcds_q45/duckdb:vortex-file-compressed 30940743 33119027 0.93
tpcds_q46/duckdb:vortex-file-compressed 36877170 34782897 1.06
tpcds_q47/duckdb:vortex-file-compressed 54012495 56759698 0.95
tpcds_q48/duckdb:vortex-file-compressed 31318817 34536496 0.91
tpcds_q49/duckdb:vortex-file-compressed 36844379 39282405 0.94
tpcds_q50/duckdb:vortex-file-compressed 26989543 29904667 0.90
tpcds_q51/duckdb:vortex-file-compressed 🚀 108487863 137811504 0.79
tpcds_q52/duckdb:vortex-file-compressed 15343086 16396923 0.94
tpcds_q53/duckdb:vortex-file-compressed 23910556 25936690 0.92
tpcds_q54/duckdb:vortex-file-compressed 28700327 31122276 0.92
tpcds_q55/duckdb:vortex-file-compressed 🚀 14458927 16714161 0.87
tpcds_q56/duckdb:vortex-file-compressed 27713449 28080259 0.99
tpcds_q57/duckdb:vortex-file-compressed 36716440 38044156 0.97
tpcds_q58/duckdb:vortex-file-compressed 30847771 31007513 0.99
tpcds_q59/duckdb:vortex-file-compressed 38563877 38719635 1.00
tpcds_q60/duckdb:vortex-file-compressed 29526800 28742291 1.03
tpcds_q61/duckdb:vortex-file-compressed 33791526 33607635 1.01
tpcds_q62/duckdb:vortex-file-compressed 15017334 16347225 0.92
tpcds_q63/duckdb:vortex-file-compressed 21279153 22455730 0.95
tpcds_q64/duckdb:vortex-file-compressed 97108790 104130212 0.93
tpcds_q65/duckdb:vortex-file-compressed 23640294 23634184 1.00
tpcds_q66/duckdb:vortex-file-compressed 28928596 31419376 0.92
tpcds_q67/duckdb:vortex-file-compressed 138900652 151060354 0.92
tpcds_q68/duckdb:vortex-file-compressed 37591403 34223102 1.10
tpcds_q69/duckdb:vortex-file-compressed 44420815 44829360 0.99
tpcds_q70/duckdb:vortex-file-compressed 32635835 34218738 0.95
tpcds_q71/duckdb:vortex-file-compressed 22471015 24379780 0.92
tpcds_q72/duckdb:vortex-file-compressed 155303900 167609745 0.93
tpcds_q73/duckdb:vortex-file-compressed 27972211 30889200 0.91
tpcds_q74/duckdb:vortex-file-compressed 46347959 48509019 0.96
tpcds_q75/duckdb:vortex-file-compressed 49376359 51552418 0.96
tpcds_q76/duckdb:vortex-file-compressed 🚀 21224759 24689656 0.86
tpcds_q77/duckdb:vortex-file-compressed 24061584 25642656 0.94
tpcds_q78/duckdb:vortex-file-compressed 66816074 69808387 0.96
tpcds_q79/duckdb:vortex-file-compressed 28141951 30560596 0.92
tpcds_q80/duckdb:vortex-file-compressed 🚀 46767542 52333824 0.89
tpcds_q81/duckdb:vortex-file-compressed 29544218 31861055 0.93
tpcds_q82/duckdb:vortex-file-compressed 46492427 48838564 0.95
tpcds_q83/duckdb:vortex-file-compressed 27937447 29195624 0.96
tpcds_q84/duckdb:vortex-file-compressed 16875119 17724686 0.95
tpcds_q85/duckdb:vortex-file-compressed 43133843 45580916 0.95
tpcds_q86/duckdb:vortex-file-compressed 16690382 17099014 0.98
tpcds_q87/duckdb:vortex-file-compressed 🚀 39089711 45497419 0.86
tpcds_q88/duckdb:vortex-file-compressed 57128162 59378843 0.96
tpcds_q89/duckdb:vortex-file-compressed 24082556 23355465 1.03
tpcds_q90/duckdb:vortex-file-compressed 🚀 10698630 12101643 0.88
tpcds_q91/duckdb:vortex-file-compressed 22010640 24321559 0.90
tpcds_q92/duckdb:vortex-file-compressed 18306327 19128875 0.96
tpcds_q93/duckdb:vortex-file-compressed 27384246 29763255 0.92
tpcds_q94/duckdb:vortex-file-compressed 🚀 21652333 24293239 0.89
tpcds_q95/duckdb:vortex-file-compressed 123595969 127719039 0.97
tpcds_q96/duckdb:vortex-file-compressed 13624805 13809188 0.99
tpcds_q97/duckdb:vortex-file-compressed 39411292 41167615 0.96
tpcds_q98/duckdb:vortex-file-compressed 19664723 20479837 0.96
tpcds_q99/duckdb:vortex-file-compressed 18072232 19270275 0.94
duckdb / vortex-compact (0.953x ➖, 12↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 24076579 25829877 0.93
tpcds_q02/duckdb:vortex-compact 25237852 26927705 0.94
tpcds_q03/duckdb:vortex-compact 46611256 47621609 0.98
tpcds_q04/duckdb:vortex-compact 113709156 114053053 1.00
tpcds_q05/duckdb:vortex-compact 54372493 55883521 0.97
tpcds_q06/duckdb:vortex-compact 48385469 50986716 0.95
tpcds_q07/duckdb:vortex-compact 59399379 61242534 0.97
tpcds_q08/duckdb:vortex-compact 106823883 106039289 1.01
tpcds_q09/duckdb:vortex-compact 25067420 27621815 0.91
tpcds_q10/duckdb:vortex-compact 78372870 81668413 0.96
tpcds_q11/duckdb:vortex-compact 88458880 90943487 0.97
tpcds_q12/duckdb:vortex-compact 18954156 20542703 0.92
tpcds_q13/duckdb:vortex-compact 85696031 89777766 0.95
tpcds_q14/duckdb:vortex-compact 137752290 145687082 0.95
tpcds_q15/duckdb:vortex-compact 🚀 32446083 37028153 0.88
tpcds_q16/duckdb:vortex-compact 🚀 29036922 33179792 0.88
tpcds_q17/duckdb:vortex-compact 88880050 91478979 0.97
tpcds_q18/duckdb:vortex-compact 🚀 54820046 64886165 0.84
tpcds_q19/duckdb:vortex-compact 66138438 67804415 0.98
tpcds_q20/duckdb:vortex-compact 18228887 20196079 0.90
tpcds_q21/duckdb:vortex-compact 17526594 18484673 0.95
tpcds_q22/duckdb:vortex-compact 74319613 79383874 0.94
tpcds_q23/duckdb:vortex-compact 130613762 133852720 0.98
tpcds_q24/duckdb:vortex-compact 74182899 74617862 0.99
tpcds_q25/duckdb:vortex-compact 60045652 63285574 0.95
tpcds_q26/duckdb:vortex-compact 33663102 34769167 0.97
tpcds_q27/duckdb:vortex-compact 67409745 69093448 0.98
tpcds_q28/duckdb:vortex-compact 22219007 24202657 0.92
tpcds_q29/duckdb:vortex-compact 84721441 90105088 0.94
tpcds_q30/duckdb:vortex-compact 🚀 28883316 35327450 0.82
tpcds_q31/duckdb:vortex-compact 48516079 52737453 0.92
tpcds_q32/duckdb:vortex-compact 🚀 17840433 20071168 0.89
tpcds_q33/duckdb:vortex-compact 46326279 47949783 0.97
tpcds_q34/duckdb:vortex-compact 54366098 56400557 0.96
tpcds_q35/duckdb:vortex-compact 104693128 106957408 0.98
tpcds_q36/duckdb:vortex-compact 47751628 48022166 0.99
tpcds_q37/duckdb:vortex-compact 22108826 23449120 0.94
tpcds_q38/duckdb:vortex-compact 55512550 56953423 0.97
tpcds_q39/duckdb:vortex-compact 33646055 31051663 1.08
tpcds_q40/duckdb:vortex-compact 20832722 22435780 0.93
tpcds_q41/duckdb:vortex-compact 13631716 14928184 0.91
tpcds_q42/duckdb:vortex-compact 24088509 24977033 0.96
tpcds_q43/duckdb:vortex-compact 40860050 38761373 1.05
tpcds_q44/duckdb:vortex-compact 36463912 35966601 1.01
tpcds_q45/duckdb:vortex-compact 39446764 40090445 0.98
tpcds_q46/duckdb:vortex-compact 73979122 76070020 0.97
tpcds_q47/duckdb:vortex-compact 73083944 75789152 0.96
tpcds_q48/duckdb:vortex-compact 74009649 75552716 0.98
tpcds_q49/duckdb:vortex-compact 62369610 64408347 0.97
tpcds_q50/duckdb:vortex-compact 59398851 62045779 0.96
tpcds_q51/duckdb:vortex-compact 116266743 124351936 0.93
tpcds_q52/duckdb:vortex-compact 🚀 24096864 26788139 0.90
tpcds_q53/duckdb:vortex-compact 46539072 47418228 0.98
tpcds_q54/duckdb:vortex-compact 48056640 51689742 0.93
tpcds_q55/duckdb:vortex-compact 24151681 26159016 0.92
tpcds_q56/duckdb:vortex-compact 45837474 48115467 0.95
tpcds_q57/duckdb:vortex-compact 40479666 41362422 0.98
tpcds_q58/duckdb:vortex-compact 42898580 43065554 1.00
tpcds_q59/duckdb:vortex-compact 57269629 58415755 0.98
tpcds_q60/duckdb:vortex-compact 50102263 50414744 0.99
tpcds_q61/duckdb:vortex-compact 89583458 91752157 0.98
tpcds_q62/duckdb:vortex-compact 18142839 18867165 0.96
tpcds_q63/duckdb:vortex-compact 43873210 45144244 0.97
tpcds_q64/duckdb:vortex-compact 167214276 171159148 0.98
tpcds_q65/duckdb:vortex-compact 40406439 41641920 0.97
tpcds_q66/duckdb:vortex-compact 37592380 38423517 0.98
tpcds_q67/duckdb:vortex-compact 164719335 172078324 0.96
tpcds_q68/duckdb:vortex-compact 74141633 77619816 0.96
tpcds_q69/duckdb:vortex-compact 80281774 85352288 0.94
tpcds_q70/duckdb:vortex-compact 71756112 75181963 0.95
tpcds_q71/duckdb:vortex-compact 44058388 44685656 0.99
tpcds_q72/duckdb:vortex-compact 174796492 175639104 1.00
tpcds_q73/duckdb:vortex-compact 53194651 53898085 0.99
tpcds_q74/duckdb:vortex-compact 62570174 64699113 0.97
tpcds_q75/duckdb:vortex-compact 66325047 69639132 0.95
tpcds_q76/duckdb:vortex-compact 36253599 37682790 0.96
tpcds_q77/duckdb:vortex-compact 47633944 48262417 0.99
tpcds_q78/duckdb:vortex-compact 82611017 85627059 0.96
tpcds_q79/duckdb:vortex-compact 88507600 91153823 0.97
tpcds_q80/duckdb:vortex-compact 77300242 79948846 0.97
tpcds_q81/duckdb:vortex-compact 34471347 35883485 0.96
tpcds_q82/duckdb:vortex-compact 49602007 51169475 0.97
tpcds_q83/duckdb:vortex-compact 36019563 36954229 0.97
tpcds_q84/duckdb:vortex-compact 🚀 19948686 22778899 0.88
tpcds_q85/duckdb:vortex-compact 64726520 68631945 0.94
tpcds_q86/duckdb:vortex-compact 18672073 19726430 0.95
tpcds_q87/duckdb:vortex-compact 57092336 63421094 0.90
tpcds_q88/duckdb:vortex-compact 235793516 240090852 0.98
tpcds_q89/duckdb:vortex-compact 44389753 44833662 0.99
tpcds_q90/duckdb:vortex-compact 🚀 16488652 18840233 0.88
tpcds_q91/duckdb:vortex-compact 🚀 55467374 61890649 0.90
tpcds_q92/duckdb:vortex-compact 🚀 33084994 37019194 0.89
tpcds_q93/duckdb:vortex-compact 36402195 37914461 0.96
tpcds_q94/duckdb:vortex-compact 32454407 33713685 0.96
tpcds_q95/duckdb:vortex-compact 133805305 141730353 0.94
tpcds_q96/duckdb:vortex-compact 37963520 39557337 0.96
tpcds_q97/duckdb:vortex-compact 🚀 45720685 51152666 0.89
tpcds_q98/duckdb:vortex-compact 🚀 31904104 35956101 0.89
tpcds_q99/duckdb:vortex-compact 22502681 23860290 0.94
duckdb / parquet (0.966x ➖, 1↑ 1↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 29383981 31032649 0.95
tpcds_q02/duckdb:parquet 24523252 24545004 1.00
tpcds_q03/duckdb:parquet 13659511 12879602 1.06
tpcds_q04/duckdb:parquet 169356030 171355160 0.99
tpcds_q05/duckdb:parquet 32906850 34962185 0.94
tpcds_q06/duckdb:parquet 33915894 35597143 0.95
tpcds_q07/duckdb:parquet 24551776 25529451 0.96
tpcds_q08/duckdb:parquet 30659837 30888577 0.99
tpcds_q09/duckdb:parquet 45725784 45577534 1.00
tpcds_q10/duckdb:parquet 39781954 39698697 1.00
tpcds_q11/duckdb:parquet 94009577 98715189 0.95
tpcds_q12/duckdb:parquet 16359133 16804684 0.97
tpcds_q13/duckdb:parquet 35639633 36225565 0.98
tpcds_q14/duckdb:parquet 102751764 106606556 0.96
tpcds_q15/duckdb:parquet 31250036 32666030 0.96
tpcds_q16/duckdb:parquet 24016243 23680959 1.01
tpcds_q17/duckdb:parquet 40978849 40748361 1.01
tpcds_q18/duckdb:parquet 47924059 51801575 0.93
tpcds_q19/duckdb:parquet 32144131 32809233 0.98
tpcds_q20/duckdb:parquet 16886937 17972807 0.94
tpcds_q21/duckdb:parquet 11637009 12400160 0.94
tpcds_q22/duckdb:parquet 68851724 76020062 0.91
tpcds_q23/duckdb:parquet 82091508 86241442 0.95
tpcds_q24/duckdb:parquet 47017799 48598760 0.97
tpcds_q25/duckdb:parquet 35935391 37509269 0.96
tpcds_q26/duckdb:parquet 39759169 42595835 0.93
tpcds_q27/duckdb:parquet 54003103 56703169 0.95
tpcds_q28/duckdb:parquet 43438127 45487127 0.95
tpcds_q29/duckdb:parquet 36962850 38828294 0.95
tpcds_q30/duckdb:parquet 38118681 39542190 0.96
tpcds_q31/duckdb:parquet 28330787 29236078 0.97
tpcds_q32/duckdb:parquet 12468317 13092026 0.95
tpcds_q33/duckdb:parquet 24386931 25276010 0.96
tpcds_q34/duckdb:parquet 24761400 23681603 1.05
tpcds_q35/duckdb:parquet 61766610 63113891 0.98
tpcds_q36/duckdb:parquet 22796629 23142883 0.99
tpcds_q37/duckdb:parquet 15210133 15061496 1.01
tpcds_q38/duckdb:parquet 37058155 38113122 0.97
tpcds_q39/duckdb:parquet 31731915 33458821 0.95
tpcds_q40/duckdb:parquet 19895291 20634861 0.96
tpcds_q41/duckdb:parquet 8856069 9339353 0.95
tpcds_q42/duckdb:parquet 🚨 14468476 12703701 1.14
tpcds_q43/duckdb:parquet 16975569 18835153 0.90
tpcds_q44/duckdb:parquet 25314321 27704084 0.91
tpcds_q45/duckdb:parquet 28722710 30259984 0.95
tpcds_q46/duckdb:parquet 47843884 50024306 0.96
tpcds_q47/duckdb:parquet 50054263 52866004 0.95
tpcds_q48/duckdb:parquet 32529622 33719490 0.96
tpcds_q49/duckdb:parquet 28440326 30500786 0.93
tpcds_q50/duckdb:parquet 26874463 27395049 0.98
tpcds_q51/duckdb:parquet 105009473 112260080 0.94
tpcds_q52/duckdb:parquet 12985255 13000937 1.00
tpcds_q53/duckdb:parquet 17696150 17549916 1.01
tpcds_q54/duckdb:parquet 28793215 30964766 0.93
tpcds_q55/duckdb:parquet 12670674 13418387 0.94
tpcds_q56/duckdb:parquet 24744934 25479436 0.97
tpcds_q57/duckdb:parquet 38416539 40062526 0.96
tpcds_q58/duckdb:parquet 25970699 27569700 0.94
tpcds_q59/duckdb:parquet 37464703 37460850 1.00
tpcds_q60/duckdb:parquet 26590673 26827200 0.99
tpcds_q61/duckdb:parquet 34649945 36637482 0.95
tpcds_q62/duckdb:parquet 12989486 13498735 0.96
tpcds_q63/duckdb:parquet 15570748 16121067 0.97
tpcds_q64/duckdb:parquet 82003644 83513158 0.98
tpcds_q65/duckdb:parquet 22800452 23325096 0.98
tpcds_q66/duckdb:parquet 30066949 30336397 0.99
tpcds_q67/duckdb:parquet 137089856 142248286 0.96
tpcds_q68/duckdb:parquet 39249730 40211844 0.98
tpcds_q69/duckdb:parquet 39768058 40392160 0.98
tpcds_q70/duckdb:parquet 22905043 23211201 0.99
tpcds_q71/duckdb:parquet 24157432 23874645 1.01
tpcds_q72/duckdb:parquet 169396087 168120223 1.01
tpcds_q73/duckdb:parquet 21387957 21826146 0.98
tpcds_q74/duckdb:parquet 127950540 130375861 0.98
tpcds_q75/duckdb:parquet 57283798 59793277 0.96
tpcds_q76/duckdb:parquet 22509537 22601656 1.00
tpcds_q77/duckdb:parquet 25479591 26570334 0.96
tpcds_q78/duckdb:parquet 77685145 81546934 0.95
tpcds_q79/duckdb:parquet 30513642 31544178 0.97
tpcds_q80/duckdb:parquet 43720393 46229274 0.95
tpcds_q81/duckdb:parquet 35716154 36060036 0.99
tpcds_q82/duckdb:parquet 17123179 17724242 0.97
tpcds_q83/duckdb:parquet 18646382 19946420 0.93
tpcds_q84/duckdb:parquet 20568580 21564804 0.95
tpcds_q85/duckdb:parquet 42662573 44518393 0.96
tpcds_q86/duckdb:parquet 14016632 14477508 0.97
tpcds_q87/duckdb:parquet 39181249 41214463 0.95
tpcds_q88/duckdb:parquet 54461479 55540071 0.98
tpcds_q89/duckdb:parquet 19573621 20073332 0.98
tpcds_q90/duckdb:parquet 8548336 8933655 0.96
tpcds_q91/duckdb:parquet 25642976 26888567 0.95
tpcds_q92/duckdb:parquet 12944892 13707553 0.94
tpcds_q93/duckdb:parquet 31979598 34277186 0.93
tpcds_q94/duckdb:parquet 18406812 19548725 0.94
tpcds_q95/duckdb:parquet 🚀 124041034 151859962 0.82
tpcds_q96/duckdb:parquet 10952617 11096202 0.99
tpcds_q97/duckdb:parquet 38146637 39663830 0.96
tpcds_q98/duckdb:parquet 21803410 22816314 0.96
tpcds_q99/duckdb:parquet 20535104 20899800 0.98
duckdb / duckdb (0.959x ➖, 1↑ 1↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 22958372 22898284 1.00
tpcds_q02/duckdb:duckdb 20699898 21781258 0.95
tpcds_q03/duckdb:duckdb 10243818 11322726 0.90
tpcds_q04/duckdb:duckdb 179286350 187623800 0.96
tpcds_q05/duckdb:duckdb 21428237 22170222 0.97
tpcds_q06/duckdb:duckdb 28487160 29113546 0.98
tpcds_q07/duckdb:duckdb 40317767 42443613 0.95
tpcds_q08/duckdb:duckdb 120749673 123013649 0.98
tpcds_q09/duckdb:duckdb 20761299 21538752 0.96
tpcds_q10/duckdb:duckdb 28078501 28550474 0.98
tpcds_q11/duckdb:duckdb 94883978 101278117 0.94
tpcds_q12/duckdb:duckdb 12582322 13538359 0.93
tpcds_q13/duckdb:duckdb 25984805 27299189 0.95
tpcds_q14/duckdb:duckdb 93244856 94851810 0.98
tpcds_q15/duckdb:duckdb 25393690 26888373 0.94
tpcds_q16/duckdb:duckdb 19361025 20262329 0.96
tpcds_q17/duckdb:duckdb 24415736 25756690 0.95
tpcds_q18/duckdb:duckdb 48017547 49902437 0.96
tpcds_q19/duckdb:duckdb 19963454 20614343 0.97
tpcds_q20/duckdb:duckdb 13323677 14146496 0.94
tpcds_q21/duckdb:duckdb 7491472 8212139 0.91
tpcds_q22/duckdb:duckdb 62485019 65432273 0.95
tpcds_q23/duckdb:duckdb 80070762 79168508 1.01
tpcds_q24/duckdb:duckdb 26057134 26419304 0.99
tpcds_q25/duckdb:duckdb 19138547 19993565 0.96
tpcds_q26/duckdb:duckdb 29193850 31367984 0.93
tpcds_q27/duckdb:duckdb 42685085 43339236 0.98
tpcds_q28/duckdb:duckdb 26511946 26878349 0.99
tpcds_q29/duckdb:duckdb 24599874 25417885 0.97
tpcds_q30/duckdb:duckdb 31100216 32629124 0.95
tpcds_q31/duckdb:duckdb 52503908 56660817 0.93
tpcds_q32/duckdb:duckdb 8526675 8546343 1.00
tpcds_q33/duckdb:duckdb 16213168 16902707 0.96
tpcds_q34/duckdb:duckdb 19118226 18892128 1.01
tpcds_q35/duckdb:duckdb 37920464 39031124 0.97
tpcds_q36/duckdb:duckdb 71289053 75130566 0.95
tpcds_q37/duckdb:duckdb 8971712 9613073 0.93
tpcds_q38/duckdb:duckdb 33076013 33957857 0.97
tpcds_q39/duckdb:duckdb 28586845 29471803 0.97
tpcds_q40/duckdb:duckdb 14637237 15725970 0.93
tpcds_q41/duckdb:duckdb 10302431 9856293 1.05
tpcds_q42/duckdb:duckdb 9329713 9107021 1.02
tpcds_q43/duckdb:duckdb 15138482 15719542 0.96
tpcds_q44/duckdb:duckdb 14775471 16326346 0.91
tpcds_q45/duckdb:duckdb 19198069 20421193 0.94
tpcds_q46/duckdb:duckdb 39518421 40574457 0.97
tpcds_q47/duckdb:duckdb 46322188 50507294 0.92
tpcds_q48/duckdb:duckdb 25629645 27127901 0.94
tpcds_q49/duckdb:duckdb 21113870 21661377 0.97
tpcds_q50/duckdb:duckdb 16276794 17219613 0.95
tpcds_q51/duckdb:duckdb 99465792 102302630 0.97
tpcds_q52/duckdb:duckdb 🚨 10779725 9757562 1.10
tpcds_q53/duckdb:duckdb 15733404 16092271 0.98
tpcds_q54/duckdb:duckdb 18855068 20094387 0.94
tpcds_q55/duckdb:duckdb 9540794 9888035 0.96
tpcds_q56/duckdb:duckdb 17314057 17803239 0.97
tpcds_q57/duckdb:duckdb 36959875 37919416 0.97
tpcds_q58/duckdb:duckdb 17356341 18462348 0.94
tpcds_q59/duckdb:duckdb 36876244 38603245 0.96
tpcds_q60/duckdb:duckdb 19363679 20627847 0.94
tpcds_q61/duckdb:duckdb 16537042 18181211 0.91
tpcds_q62/duckdb:duckdb 9758576 10561858 0.92
tpcds_q63/duckdb:duckdb 14413216 14946096 0.96
tpcds_q64/duckdb:duckdb 58203954 61573984 0.95
tpcds_q65/duckdb:duckdb 36251120 37919749 0.96
tpcds_q66/duckdb:duckdb 26684573 27664668 0.96
tpcds_q67/duckdb:duckdb 133000951 138844540 0.96
tpcds_q68/duckdb:duckdb 26768764 28105376 0.95
tpcds_q69/duckdb:duckdb 28913804 28934147 1.00
tpcds_q70/duckdb:duckdb 16538807 17452695 0.95
tpcds_q71/duckdb:duckdb 16579180 17091319 0.97
tpcds_q72/duckdb:duckdb 45981517 48990233 0.94
tpcds_q73/duckdb:duckdb 14313086 13153081 1.09
tpcds_q74/duckdb:duckdb 146568178 150675617 0.97
tpcds_q75/duckdb:duckdb 45608741 47448387 0.96
tpcds_q76/duckdb:duckdb 14589313 15187555 0.96
tpcds_q77/duckdb:duckdb 15938294 16530659 0.96
tpcds_q78/duckdb:duckdb 65663177 67689318 0.97
tpcds_q79/duckdb:duckdb 20338149 21222518 0.96
tpcds_q80/duckdb:duckdb 31580525 34271074 0.92
tpcds_q81/duckdb:duckdb 39341938 42226977 0.93
tpcds_q82/duckdb:duckdb 🚀 10423511 11931454 0.87
tpcds_q83/duckdb:duckdb 10936249 11514798 0.95
tpcds_q84/duckdb:duckdb 14481410 15421022 0.94
tpcds_q85/duckdb:duckdb 26077762 27843096 0.94
tpcds_q86/duckdb:duckdb 12200543 12769325 0.96
tpcds_q87/duckdb:duckdb 36620893 36996616 0.99
tpcds_q88/duckdb:duckdb 30789296 31341719 0.98
tpcds_q89/duckdb:duckdb 16834722 17831038 0.94
tpcds_q90/duckdb:duckdb 6165836 6510900 0.95
tpcds_q91/duckdb:duckdb 14904265 15579455 0.96
tpcds_q92/duckdb:duckdb 9842782 10833346 0.91
tpcds_q93/duckdb:duckdb 23753534 25937088 0.92
tpcds_q94/duckdb:duckdb 14282769 15454854 0.92
tpcds_q95/duckdb:duckdb 110556838 120112810 0.92
tpcds_q96/duckdb:duckdb 6025423 6183275 0.97
tpcds_q97/duckdb:duckdb 31991896 33709008 0.95
tpcds_q98/duckdb:duckdb 17494767 17851224 0.98
tpcds_q99/duckdb:duckdb 16808433 17626961 0.95

No file size changes detected.

@github-actions

github-actions Bot commented Jul 27, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.2%
Engines: DataFusion No clear signal (-9.7%, low confidence) · DuckDB No clear signal (+8.2%, low confidence)
Vortex (geomean): 0.991x ➖
Parquet (geomean): 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish +1.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.909x ➖, 2↑ 1↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 47768269 34816790 1.37
fineweb_q01/datafusion:vortex-file-compressed 🚀 478726406 945213729 0.51
fineweb_q02/datafusion:vortex-file-compressed 🚀 530849528 826307286 0.64
fineweb_q03/datafusion:vortex-file-compressed 1106446700 1143825552 0.97
fineweb_q04/datafusion:vortex-file-compressed 1178956480 1165155557 1.01
fineweb_q05/datafusion:vortex-file-compressed 1072916436 1097223534 0.98
fineweb_q06/datafusion:vortex-file-compressed 1286975882 1259394554 1.02
fineweb_q07/datafusion:vortex-file-compressed 1070031312 1115998126 0.96
fineweb_q08/datafusion:vortex-file-compressed 455821254 449025285 1.02
datafusion / vortex-compact (0.997x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 31887462 27856215 1.14
fineweb_q01/datafusion:vortex-compact 515204668 681221982 0.76
fineweb_q02/datafusion:vortex-compact 583368354 605540674 0.96
fineweb_q03/datafusion:vortex-compact 1322934856 1307664767 1.01
fineweb_q04/datafusion:vortex-compact 1630315344 1600994964 1.02
fineweb_q05/datafusion:vortex-compact 1345717772 1324604660 1.02
fineweb_q06/datafusion:vortex-compact 1271273835 1258933432 1.01
fineweb_q07/datafusion:vortex-compact 1180669525 1140822562 1.03
fineweb_q08/datafusion:vortex-compact 409281971 384574915 1.06
datafusion / parquet (1.054x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1081094065 1063050913 1.02
fineweb_q01/datafusion:parquet 1816487294 1721624566 1.06
fineweb_q02/datafusion:parquet 1875093427 1728116126 1.09
fineweb_q03/datafusion:parquet 1973856936 1851304814 1.07
fineweb_q04/datafusion:parquet 1797073109 1733851392 1.04
fineweb_q05/datafusion:parquet 1955612147 1798414164 1.09
fineweb_q06/datafusion:parquet 1917983818 1773754521 1.08
fineweb_q07/datafusion:parquet 1893771976 1837095268 1.03
fineweb_q08/datafusion:parquet 1917185959 1855734913 1.03
duckdb / vortex-file-compressed (1.041x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 78935308 76455159 1.03
fineweb_q01/duckdb:vortex-file-compressed 603422205 595909255 1.01
fineweb_q02/duckdb:vortex-file-compressed 641242183 517509918 1.24
fineweb_q03/duckdb:vortex-file-compressed 1313480701 1251684204 1.05
fineweb_q04/duckdb:vortex-file-compressed 1399848374 1255535662 1.11
fineweb_q05/duckdb:vortex-file-compressed 1266608880 1241364574 1.02
fineweb_q06/duckdb:vortex-file-compressed 1424316018 1384101038 1.03
fineweb_q07/duckdb:vortex-file-compressed 1349927310 1427279981 0.95
fineweb_q08/duckdb:vortex-file-compressed 550884421 576611706 0.96
duckdb / vortex-compact (1.024x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 78221226 83877279 0.93
fineweb_q01/duckdb:vortex-compact 575816927 588187662 0.98
fineweb_q02/duckdb:vortex-compact 575755914 572298034 1.01
fineweb_q03/duckdb:vortex-compact 1734159647 1649801956 1.05
fineweb_q04/duckdb:vortex-compact 1856679578 1746247481 1.06
fineweb_q05/duckdb:vortex-compact 1678350165 1627981510 1.03
fineweb_q06/duckdb:vortex-compact 1512403423 1488798612 1.02
fineweb_q07/duckdb:vortex-compact 1538753901 1351624000 1.14
fineweb_q08/duckdb:vortex-compact 461461178 458186353 1.01
duckdb / parquet (0.954x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1078401879 1137922488 0.95
fineweb_q01/duckdb:parquet 1320716563 1369296700 0.96
fineweb_q02/duckdb:parquet 1313894601 1320208409 1.00
fineweb_q03/duckdb:parquet 3539470447 3725689027 0.95
fineweb_q04/duckdb:parquet 1837713799 1984018545 0.93
fineweb_q05/duckdb:parquet 2185149982 2129116172 1.03
fineweb_q06/duckdb:parquet 4099173362 4262214705 0.96
fineweb_q07/duckdb:parquet 2563774234 2696414229 0.95
fineweb_q08/duckdb:parquet 1080210275 1241119753 0.87

@github-actions

github-actions Bot commented Jul 27, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.9%
Engines: DataFusion No clear signal (+1.1%, low confidence) · DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): 1.001x ➖
Parquet (geomean): 0.993x ➖
Shifts: Parquet (control) -0.7% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.989x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 9d2735a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 425539308 450068257 0.95
tpch_q02/datafusion:vortex-file-compressed 100745328 102623739 0.98
tpch_q03/datafusion:vortex-file-compressed 191934177 193440262 0.99
tpch_q04/datafusion:vortex-file-compressed 96041215 95773045 1.00
tpch_q05/datafusion:vortex-file-compressed 330636779 330274602 1.00
tpch_q06/datafusion:vortex-file-compressed 38244746 38904257 0.98
tpch_q07/datafusion:vortex-file-compressed 441357100 450799583 0.98
tpch_q08/datafusion:vortex-file-compressed 340904763 344956397 0.99
tpch_q09/datafusion:vortex-file-compressed 586788544 587568614 1.00
tpch_q10/datafusion:vortex-file-compressed 210230264 219916173 0.96
tpch_q11/datafusion:vortex-file-compressed 81482555 77298667 1.05
tpch_q12/datafusion:vortex-file-compressed 110151935 110434677 1.00
tpch_q13/datafusion:vortex-file-compressed 192869943 193298537 1.00
tpch_q14/datafusion:vortex-file-compressed 49400226 50385720 0.98
tpch_q15/datafusion:vortex-file-compressed 99285564 99205063 1.00
tpch_q16/datafusion:vortex-file-compressed 72158990 74201565 0.97
tpch_q17/datafusion:vortex-file-compressed 574424594 578076327 0.99
tpch_q18/datafusion:vortex-file-compressed 815613935 825833443 0.99
tpch_q19/datafusion:vortex-file-compressed 78594044 78090543 1.01
tpch_q20/datafusion:vortex-file-compressed 154576654 160461719 0.96
tpch_q21/datafusion:vortex-file-compressed 583713596 587214191 0.99
tpch_q22/datafusion:vortex-file-compressed 54519739 54991022 0.99
datafusion / vortex-compact (0.999x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 9d2735a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 502303716 508906949 0.99
tpch_q02/datafusion:vortex-compact 107435935 105332939 1.02
tpch_q03/datafusion:vortex-compact 212956186 212823971 1.00
tpch_q04/datafusion:vortex-compact 126485975 126907574 1.00
tpch_q05/datafusion:vortex-compact 346655923 343894230 1.01
tpch_q06/datafusion:vortex-compact 60685150 60961925 1.00
tpch_q07/datafusion:vortex-compact 479805817 482089744 1.00
tpch_q08/datafusion:vortex-compact 357823574 360726715 0.99
tpch_q09/datafusion:vortex-compact 606602967 612957182 0.99
tpch_q10/datafusion:vortex-compact 262050739 270904442 0.97
tpch_q11/datafusion:vortex-compact 81053604 77228898 1.05
tpch_q12/datafusion:vortex-compact 174140390 175670112 0.99
tpch_q13/datafusion:vortex-compact 241251345 238928796 1.01
tpch_q14/datafusion:vortex-compact 68142707 66965858 1.02
tpch_q15/datafusion:vortex-compact 150917585 152080580 0.99
tpch_q16/datafusion:vortex-compact 79851553 79509518 1.00
tpch_q17/datafusion:vortex-compact 580572584 593527564 0.98
tpch_q18/datafusion:vortex-compact 863694892 858586037 1.01
tpch_q19/datafusion:vortex-compact 209699104 205867178 1.02
tpch_q20/datafusion:vortex-compact 180963843 178070118 1.02
tpch_q21/datafusion:vortex-compact 674214800 667756232 1.01
tpch_q22/datafusion:vortex-compact 57445712 60730570 0.95
datafusion / parquet (0.983x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 9d2735a (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 472512390 478916464 0.99
tpch_q02/datafusion:parquet 165555039 178066387 0.93
tpch_q03/datafusion:parquet 250692654 253650954 0.99
tpch_q04/datafusion:parquet 115291830 120326483 0.96
tpch_q05/datafusion:parquet 388086314 395781694 0.98
tpch_q06/datafusion:parquet 128587956 131792356 0.98
tpch_q07/datafusion:parquet 555876121 568876074 0.98
tpch_q08/datafusion:parquet 443084612 450254734 0.98
tpch_q09/datafusion:parquet 704973503 721536102 0.98
tpch_q10/datafusion:parquet 534046061 574856912 0.93
tpch_q11/datafusion:parquet 118995838 118527165 1.00
tpch_q12/datafusion:parquet 203910630 210891780 0.97
tpch_q13/datafusion:parquet 351550026 347197456 1.01
tpch_q14/datafusion:parquet 153263497 154335537 0.99
tpch_q15/datafusion:parquet 266257799 258215357 1.03
tpch_q16/datafusion:parquet 116717127 126874836 0.92
tpch_q17/datafusion:parquet 675835768 666146471 1.01
tpch_q18/datafusion:parquet 858101331 871490965 0.98
tpch_q19/datafusion:parquet 279061751 280630694 0.99
tpch_q20/datafusion:parquet 297132101 300174835 0.99
tpch_q21/datafusion:parquet 655854244 653323765 1.00
tpch_q22/datafusion:parquet 216646556 209427355 1.03
duckdb / vortex-file-compressed (1.008x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 9d2735a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 170171175 168552584 1.01
tpch_q02/duckdb:vortex-file-compressed 52338998 53234989 0.98
tpch_q03/duckdb:vortex-file-compressed 120442942 117076984 1.03
tpch_q04/duckdb:vortex-file-compressed 154458769 152051241 1.02
tpch_q05/duckdb:vortex-file-compressed 135436700 133867370 1.01
tpch_q06/duckdb:vortex-file-compressed 34429211 34138170 1.01
tpch_q07/duckdb:vortex-file-compressed 129858414 129676417 1.00
tpch_q08/duckdb:vortex-file-compressed 170401030 169157987 1.01
tpch_q09/duckdb:vortex-file-compressed 394033217 391315664 1.01
tpch_q10/duckdb:vortex-file-compressed 193343447 190664509 1.01
tpch_q11/duckdb:vortex-file-compressed 31040382 30129924 1.03
tpch_q12/duckdb:vortex-file-compressed 104727880 105413902 0.99
tpch_q13/duckdb:vortex-file-compressed 270644252 271563685 1.00
tpch_q14/duckdb:vortex-file-compressed 55078346 53564151 1.03
tpch_q15/duckdb:vortex-file-compressed 88705422 88018734 1.01
tpch_q16/duckdb:vortex-file-compressed 76880029 75543100 1.02
tpch_q17/duckdb:vortex-file-compressed 88380218 87033840 1.02
tpch_q18/duckdb:vortex-file-compressed 285260328 288133164 0.99
tpch_q19/duckdb:vortex-file-compressed 75148075 75399351 1.00
tpch_q20/duckdb:vortex-file-compressed 139365019 139038066 1.00
tpch_q21/duckdb:vortex-file-compressed 479623657 473502835 1.01
tpch_q22/duckdb:vortex-file-compressed 63820046 63684611 1.00
duckdb / vortex-compact (1.006x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 9d2735a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 272765543 270666357 1.01
tpch_q02/duckdb:vortex-compact 61103949 61361426 1.00
tpch_q03/duckdb:vortex-compact 157225116 155923397 1.01
tpch_q04/duckdb:vortex-compact 214475917 212488848 1.01
tpch_q05/duckdb:vortex-compact 182448844 179167440 1.02
tpch_q06/duckdb:vortex-compact 57615933 57847132 1.00
tpch_q07/duckdb:vortex-compact 216758233 213435597 1.02
tpch_q08/duckdb:vortex-compact 216662888 215760204 1.00
tpch_q09/duckdb:vortex-compact 461677483 464714086 0.99
tpch_q10/duckdb:vortex-compact 258125516 258102604 1.00
tpch_q11/duckdb:vortex-compact 38241708 38577770 0.99
tpch_q12/duckdb:vortex-compact 191750126 192833063 0.99
tpch_q13/duckdb:vortex-compact 322497462 320442495 1.01
tpch_q14/duckdb:vortex-compact 73478767 73397792 1.00
tpch_q15/duckdb:vortex-compact 118586979 117548057 1.01
tpch_q16/duckdb:vortex-compact 80855782 79761894 1.01
tpch_q17/duckdb:vortex-compact 105178503 104124892 1.01
tpch_q18/duckdb:vortex-compact 350817939 348477512 1.01
tpch_q19/duckdb:vortex-compact 92284795 88821308 1.04
tpch_q20/duckdb:vortex-compact 180656930 180932050 1.00
tpch_q21/duckdb:vortex-compact 629932999 621743670 1.01
tpch_q22/duckdb:vortex-compact 72200480 71710009 1.01
duckdb / parquet (1.002x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 9d2735a (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 267871966 260938053 1.03
tpch_q02/duckdb:parquet 104596954 102980899 1.02
tpch_q03/duckdb:parquet 213189531 213357049 1.00
tpch_q04/duckdb:parquet 137337541 138093175 0.99
tpch_q05/duckdb:parquet 224461250 230459681 0.97
tpch_q06/duckdb:parquet 76123358 75202937 1.01
tpch_q07/duckdb:parquet 188371607 188287075 1.00
tpch_q08/duckdb:parquet 269387127 270171708 1.00
tpch_q09/duckdb:parquet 512994321 507134633 1.01
tpch_q10/duckdb:parquet 629525492 625165942 1.01
tpch_q11/duckdb:parquet 65712768 69217436 0.95
tpch_q12/duckdb:parquet 136230962 134864705 1.01
tpch_q13/duckdb:parquet 445278714 449052782 0.99
tpch_q14/duckdb:parquet 183585973 181174642 1.01
tpch_q15/duckdb:parquet 104524111 103971215 1.01
tpch_q16/duckdb:parquet 169052984 166384507 1.02
tpch_q17/duckdb:parquet 182490556 185890843 0.98
tpch_q18/duckdb:parquet 365009532 359931461 1.01
tpch_q19/duckdb:parquet 289204387 287619497 1.01
tpch_q20/duckdb:parquet 236404736 232537544 1.02
tpch_q21/duckdb:parquet 573012457 563989326 1.02
tpch_q22/duckdb:parquet 305554919 306536193 1.00
duckdb / duckdb (1.003x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 9d2735a (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 120779547 120416247 1.00
tpch_q02/duckdb:duckdb 49582751 49039476 1.01
tpch_q03/duckdb:duckdb 105980010 103482184 1.02
tpch_q04/duckdb:duckdb 138717708 139976221 0.99
tpch_q05/duckdb:duckdb 120874996 119362859 1.01
tpch_q06/duckdb:duckdb 44973458 44490968 1.01
tpch_q07/duckdb:duckdb 91355699 91312106 1.00
tpch_q08/duckdb:duckdb 119013539 118183779 1.01
tpch_q09/duckdb:duckdb 283088406 282316555 1.00
tpch_q10/duckdb:duckdb 215989144 214072397 1.01
tpch_q11/duckdb:duckdb 19340646 19331312 1.00
tpch_q12/duckdb:duckdb 91269840 89631621 1.02
tpch_q13/duckdb:duckdb 231375604 229377377 1.01
tpch_q14/duckdb:duckdb 78008795 77357377 1.01
tpch_q15/duckdb:duckdb 82188448 82182968 1.00
tpch_q16/duckdb:duckdb 76506053 76700548 1.00
tpch_q17/duckdb:duckdb 88247085 87430998 1.01
tpch_q18/duckdb:duckdb 234608281 234238000 1.00
tpch_q19/duckdb:duckdb 124787158 123553665 1.01
tpch_q20/duckdb:duckdb 118159277 117363696 1.01
tpch_q21/duckdb:duckdb 303105798 303676795 1.00
tpch_q22/duckdb:duckdb 67665871 71792778 0.94

No file size changes detected.

@github-actions

github-actions Bot commented Jul 27, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): 1.003x ➖
Parquet (geomean): 1.009x ➖
Shifts: Parquet (control) +0.9% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
duckdb / vortex-file-compressed (1.006x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11810289 11595189 1.02
statpopgen_q01/duckdb:vortex-file-compressed 12779941 12874533 0.99
statpopgen_q02/duckdb:vortex-file-compressed 522294629 531151265 0.98
statpopgen_q03/duckdb:vortex-file-compressed 1036681329 1036662037 1.00
statpopgen_q04/duckdb:vortex-file-compressed 1043660010 1045363970 1.00
statpopgen_q05/duckdb:vortex-file-compressed 478787126 466667963 1.03
statpopgen_q06/duckdb:vortex-file-compressed 1525984015 1505282451 1.01
statpopgen_q07/duckdb:vortex-file-compressed 190099755 193158848 0.98
statpopgen_q08/duckdb:vortex-file-compressed 223145568 216007940 1.03
statpopgen_q09/duckdb:vortex-file-compressed 838833966 826060533 1.02
statpopgen_q10/duckdb:vortex-file-compressed 2545114591 2536115101 1.00
duckdb / vortex-compact (1.000x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11576154 11485025 1.01
statpopgen_q01/duckdb:vortex-compact 15509819 14995500 1.03
statpopgen_q02/duckdb:vortex-compact 555975669 559994919 0.99
statpopgen_q03/duckdb:vortex-compact 1153328692 1151912005 1.00
statpopgen_q04/duckdb:vortex-compact 1150458242 1152268211 1.00
statpopgen_q05/duckdb:vortex-compact 564916309 586159850 0.96
statpopgen_q06/duckdb:vortex-compact 1476957592 1471868015 1.00
statpopgen_q07/duckdb:vortex-compact 855422552 857575911 1.00
statpopgen_q08/duckdb:vortex-compact 885175615 880756760 1.01
statpopgen_q09/duckdb:vortex-compact 921389197 925829598 1.00
statpopgen_q10/duckdb:vortex-compact 2587424095 2581894833 1.00
duckdb / parquet (1.009x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 335740981 330751260 1.02
statpopgen_q01/duckdb:parquet 419880587 408050233 1.03
statpopgen_q02/duckdb:parquet 791012450 802505709 0.99
statpopgen_q03/duckdb:parquet 1233035031 1211968078 1.02
statpopgen_q04/duckdb:parquet 1234380623 1239931740 1.00
statpopgen_q05/duckdb:parquet 846002547 849247023 1.00
statpopgen_q06/duckdb:parquet 1467978935 1453176507 1.01
statpopgen_q07/duckdb:parquet 898800847 866270732 1.04
statpopgen_q08/duckdb:parquet 893560909 879172488 1.02
statpopgen_q09/duckdb:parquet 1043563467 1031445475 1.01
statpopgen_q10/duckdb:parquet 2240569182 2267361835 0.99

No file size changes detected.

@github-actions

github-actions Bot commented Jul 27, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (-7.7%, environment too noisy confidence) · DuckDB No clear signal (+5.2%, low confidence)
Vortex (geomean): 1.025x ➖
Parquet (geomean): 1.012x ➖
Shifts: Parquet (control) +1.2% · Median polish -0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.945x ➖, 2↑ 0↓)
name PR 2d4d608 (ns) base 9d2735a (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:vortex-file-compressed 🚀 390529073 510261488 0.77
clickbench-sorted_q24/datafusion:vortex-file-compressed 27325568 24984224 1.09
clickbench-sorted_q26/datafusion:vortex-file-compressed 25482476 24175505 1.05
clickbench-sorted_q36/datafusion:vortex-file-compressed 68202775 71455957 0.95
clickbench-sorted_q37/datafusion:vortex-file-compressed 🚀 45389299 52506765 0.86
clickbench-sorted_q38/datafusion:vortex-file-compressed 42366753 44501378 0.95
clickbench-sorted_q39/datafusion:vortex-file-compressed 109567781 114689457 0.96
clickbench-sorted_q40/datafusion:vortex-file-compressed 22795584 23831293 0.96
clickbench-sorted_q41/datafusion:vortex-file-compressed 21286096 22539022 0.94
clickbench-sorted_q42/datafusion:vortex-file-compressed 16320662 17206792 0.95
datafusion / parquet (1.024x ➖, 0↑ 1↓)
name PR 2d4d608 (ns) base 9d2735a (ns) ratio (PR/base)
clickbench-sorted_q23/datafusion:parquet 4757923388 4718483993 1.01
clickbench-sorted_q24/datafusion:parquet 🚨 75978085 64809097 1.17
clickbench-sorted_q26/datafusion:parquet 63728654 66029922 0.97
clickbench-sorted_q36/datafusion:parquet 224668175 207238648 1.08
clickbench-sorted_q37/datafusion:parquet 141492359 147750157 0.96
clickbench-sorted_q38/datafusion:parquet 196189607 192698918 1.02
clickbench-sorted_q39/datafusion:parquet 330966491 328912443 1.01
clickbench-sorted_q40/datafusion:parquet 101289465 102875772 0.98
clickbench-sorted_q41/datafusion:parquet 99836877 94444943 1.06
clickbench-sorted_q42/datafusion:parquet 67458266 67514816 1.00
duckdb / vortex-file-compressed (1.111x ❌, 0↑ 4↓)
name PR 2d4d608 (ns) base 9d2735a (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:vortex-file-compressed 🚨 157915264 142323088 1.11
clickbench-sorted_q24/duckdb:vortex-file-compressed 🚨 26766937 23112722 1.16
clickbench-sorted_q26/duckdb:vortex-file-compressed 🚨 47099557 28068943 1.68
clickbench-sorted_q36/duckdb:vortex-file-compressed 57525227 56632770 1.02
clickbench-sorted_q37/duckdb:vortex-file-compressed 🚨 47272627 42250226 1.12
clickbench-sorted_q38/duckdb:vortex-file-compressed 50990841 51422292 0.99
clickbench-sorted_q39/duckdb:vortex-file-compressed 113735182 107131856 1.06
clickbench-sorted_q40/duckdb:vortex-file-compressed 29922818 28127430 1.06
clickbench-sorted_q41/duckdb:vortex-file-compressed 28671639 27885414 1.03
clickbench-sorted_q42/duckdb:vortex-file-compressed 24923242 24483549 1.02
duckdb / parquet (1.001x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 9d2735a (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:parquet 190553929 196434489 0.97
clickbench-sorted_q24/duckdb:parquet 30872908 29959135 1.03
clickbench-sorted_q26/duckdb:parquet 24793867 23671375 1.05
clickbench-sorted_q36/duckdb:parquet 110245714 110506804 1.00
clickbench-sorted_q37/duckdb:parquet 96458421 92610523 1.04
clickbench-sorted_q38/duckdb:parquet 99190897 98181263 1.01
clickbench-sorted_q39/duckdb:parquet 176685073 181399816 0.97
clickbench-sorted_q40/duckdb:parquet 42084058 42412892 0.99
clickbench-sorted_q41/duckdb:parquet 41976717 43811913 0.96
clickbench-sorted_q42/duckdb:parquet 30385802 30559439 0.99
duckdb / duckdb (0.998x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 9d2735a (ns) ratio (PR/base)
clickbench-sorted_q23/duckdb:duckdb 290604920 294991538 0.99
clickbench-sorted_q24/duckdb:duckdb 45995521 44422383 1.04
clickbench-sorted_q26/duckdb:duckdb 41777825 42374817 0.99
clickbench-sorted_q36/duckdb:duckdb 91384986 89277924 1.02
clickbench-sorted_q37/duckdb:duckdb 80372417 82593242 0.97
clickbench-sorted_q38/duckdb:duckdb 66042205 64522929 1.02
clickbench-sorted_q39/duckdb:duckdb 119190791 121172857 0.98
clickbench-sorted_q40/duckdb:duckdb 44274999 44981907 0.98
clickbench-sorted_q41/duckdb:duckdb 43615056 44213357 0.99
clickbench-sorted_q42/duckdb:duckdb 35884709 35739070 1.00
File Size Changes (201 files changed, +0.0% overall, 109↑ 92↓)
File Scale Format Base HEAD Change %
hits_067.vortex 1.0 vortex-compact 99.09 MB 100.91 MB +1.83 MB +1.8%
hits_090.vortex 1.0 vortex-file-compressed 192.55 MB 195.23 MB +2.68 MB +1.4%
hits_027.vortex 1.0 vortex-file-compressed 190.11 MB 192.58 MB +2.47 MB +1.3%
hits_006.vortex 1.0 vortex-compact 94.25 MB 95.45 MB +1.20 MB +1.3%
hits_064.vortex 1.0 vortex-file-compressed 190.94 MB 193.31 MB +2.37 MB +1.2%
hits_087.vortex 1.0 vortex-compact 124.19 MB 125.67 MB +1.48 MB +1.2%
hits_026.vortex 1.0 vortex-compact 97.93 MB 99.04 MB +1.12 MB +1.1%
hits_078.vortex 1.0 vortex-compact 97.18 MB 98.21 MB +1.04 MB +1.1%
hits_049.vortex 1.0 vortex-compact 139.30 MB 140.48 MB +1.18 MB +0.8%
hits_012.vortex 1.0 vortex-compact 138.85 MB 139.98 MB +1.13 MB +0.8%
hits_041.vortex 1.0 vortex-compact 97.69 MB 98.47 MB +792.77 KB +0.8%
hits_050.vortex 1.0 vortex-file-compressed 159.82 MB 161.01 MB +1.20 MB +0.7%
hits_033.vortex 1.0 vortex-compact 152.51 MB 153.62 MB +1.11 MB +0.7%
hits_063.vortex 1.0 vortex-compact 98.19 MB 98.86 MB +690.82 KB +0.7%
hits_060.vortex 1.0 vortex-compact 140.21 MB 141.15 MB +962.26 KB +0.7%
hits_048.vortex 1.0 vortex-file-compressed 198.30 MB 199.56 MB +1.26 MB +0.6%
hits_096.vortex 1.0 vortex-file-compressed 198.24 MB 199.36 MB +1.13 MB +0.6%
hits_052.vortex 1.0 vortex-compact 97.97 MB 98.48 MB +522.89 KB +0.5%
hits_030.vortex 1.0 vortex-compact 97.76 MB 98.26 MB +504.20 KB +0.5%
hits_018.vortex 1.0 vortex-compact 152.93 MB 153.64 MB +731.91 KB +0.5%
hits_031.vortex 1.0 vortex-compact 111.13 MB 111.64 MB +517.96 KB +0.5%
hits_002.vortex 1.0 vortex-compact 123.78 MB 124.24 MB +465.09 KB +0.4%
hits_099.vortex 1.0 vortex-compact 132.96 MB 133.45 MB +498.30 KB +0.4%
hits_098.vortex 1.0 vortex-compact 103.80 MB 104.18 MB +388.56 KB +0.4%
hits_079.vortex 1.0 vortex-file-compressed 180.90 MB 181.50 MB +618.50 KB +0.3%
hits_095.vortex 1.0 vortex-compact 110.64 MB 110.99 MB +355.11 KB +0.3%
hits_097.vortex 1.0 vortex-compact 141.34 MB 141.76 MB +432.21 KB +0.3%
hits_034.vortex 1.0 vortex-file-compressed 182.06 MB 182.55 MB +503.31 KB +0.3%
hits_060.vortex 1.0 vortex-file-compressed 193.00 MB 193.48 MB +495.64 KB +0.3%
hits_000.vortex 1.0 vortex-compact 98.42 MB 98.66 MB +251.28 KB +0.2%
hits_061.vortex 1.0 vortex-compact 124.97 MB 125.28 MB +315.81 KB +0.2%
hits_008.vortex 1.0 vortex-compact 105.87 MB 106.13 MB +263.84 KB +0.2%
hits_012.vortex 1.0 vortex-file-compressed 190.98 MB 191.43 MB +463.16 KB +0.2%
hits_020.vortex 1.0 vortex-file-compressed 160.06 MB 160.42 MB +373.90 KB +0.2%
hits_037.vortex 1.0 vortex-compact 132.60 MB 132.89 MB +296.75 KB +0.2%
hits_011.vortex 1.0 vortex-file-compressed 199.38 MB 199.81 MB +446.15 KB +0.2%
hits_050.vortex 1.0 vortex-compact 125.08 MB 125.35 MB +273.58 KB +0.2%
hits_072.vortex 1.0 vortex-file-compressed 102.34 MB 102.52 MB +189.39 KB +0.2%
hits_035.vortex 1.0 vortex-file-compressed 102.77 MB 102.95 MB +187.99 KB +0.2%
hits_044.vortex 1.0 vortex-compact 153.68 MB 153.96 MB +280.62 KB +0.2%
hits_017.vortex 1.0 vortex-compact 111.93 MB 112.12 MB +194.96 KB +0.2%
hits_013.vortex 1.0 vortex-compact 125.47 MB 125.68 MB +213.57 KB +0.2%
hits_073.vortex 1.0 vortex-compact 134.19 MB 134.41 MB +223.72 KB +0.2%
hits_011.vortex 1.0 vortex-compact 152.60 MB 152.84 MB +250.41 KB +0.2%
hits_097.vortex 1.0 vortex-file-compressed 192.77 MB 193.05 MB +279.32 KB +0.1%
hits_033.vortex 1.0 vortex-file-compressed 199.98 MB 200.25 MB +278.21 KB +0.1%
hits_009.vortex 1.0 vortex-file-compressed 101.23 MB 101.36 MB +140.17 KB +0.1%
hits_093.vortex 1.0 vortex-compact 98.35 MB 98.48 MB +128.45 KB +0.1%
hits_095.vortex 1.0 vortex-file-compressed 154.32 MB 154.52 MB +196.52 KB +0.1%
hits_057.vortex 1.0 vortex-compact 111.79 MB 111.93 MB +142.34 KB +0.1%
hits_074.vortex 1.0 vortex-compact 152.71 MB 152.90 MB +192.20 KB +0.1%
hits_023.vortex 1.0 vortex-file-compressed 195.59 MB 195.82 MB +239.79 KB +0.1%
hits_092.vortex 1.0 vortex-compact 153.28 MB 153.44 MB +168.13 KB +0.1%
hits_094.vortex 1.0 vortex-file-compressed 158.61 MB 158.76 MB +154.98 KB +0.1%
hits_032.vortex 1.0 vortex-file-compressed 154.63 MB 154.77 MB +142.11 KB +0.1%
hits_058.vortex 1.0 vortex-file-compressed 155.21 MB 155.34 MB +140.49 KB +0.1%
hits_003.vortex 1.0 vortex-file-compressed 136.52 MB 136.64 MB +116.16 KB +0.1%
hits_042.vortex 1.0 vortex-file-compressed 201.37 MB 201.53 MB +166.98 KB +0.1%
hits_043.vortex 1.0 vortex-file-compressed 126.44 MB 126.53 MB +101.71 KB +0.1%
hits_025.vortex 1.0 vortex-compact 133.61 MB 133.71 MB +101.41 KB +0.1%
hits_049.vortex 1.0 vortex-file-compressed 191.22 MB 191.36 MB +143.79 KB +0.1%
hits_038.vortex 1.0 vortex-compact 139.42 MB 139.52 MB +104.28 KB +0.1%
hits_034.vortex 1.0 vortex-compact 133.26 MB 133.36 MB +99.35 KB +0.1%
hits_051.vortex 1.0 vortex-file-compressed 172.33 MB 172.46 MB +127.95 KB +0.1%
hits_040.vortex 1.0 vortex-file-compressed 143.42 MB 143.52 MB +104.53 KB +0.1%
hits_082.vortex 1.0 vortex-file-compressed 139.85 MB 139.95 MB +101.11 KB +0.1%
hits_016.vortex 1.0 vortex-file-compressed 180.11 MB 180.24 MB +129.48 KB +0.1%
hits_096.vortex 1.0 vortex-compact 153.11 MB 153.22 MB +105.84 KB +0.1%
hits_005.vortex 1.0 vortex-compact 116.28 MB 116.35 MB +73.63 KB +0.1%
hits_056.vortex 1.0 vortex-file-compressed 135.66 MB 135.74 MB +84.29 KB +0.1%
hits_051.vortex 1.0 vortex-compact 134.03 MB 134.11 MB +81.27 KB +0.1%
hits_037.vortex 1.0 vortex-file-compressed 177.08 MB 177.18 MB +106.88 KB +0.1%
hits_013.vortex 1.0 vortex-file-compressed 161.18 MB 161.27 MB +90.50 KB +0.1%
hits_093.vortex 1.0 vortex-file-compressed 131.71 MB 131.77 MB +66.32 KB +0.0%
hits_009.vortex 1.0 vortex-compact 75.23 MB 75.27 MB +35.26 KB +0.0%
hits_015.vortex 1.0 vortex-file-compressed 131.00 MB 131.06 MB +60.48 KB +0.0%
hits_022.vortex 1.0 vortex-compact 153.04 MB 153.10 MB +69.03 KB +0.0%
hits_044.vortex 1.0 vortex-file-compressed 199.99 MB 200.07 MB +85.95 KB +0.0%
hits_057.vortex 1.0 vortex-file-compressed 160.07 MB 160.13 MB +66.70 KB +0.0%
hits_098.vortex 1.0 vortex-file-compressed 137.54 MB 137.59 MB +57.05 KB +0.0%
hits_046.vortex 1.0 vortex-file-compressed 101.20 MB 101.24 MB +41.60 KB +0.0%
hits_014.vortex 1.0 vortex-file-compressed 172.08 MB 172.15 MB +70.45 KB +0.0%
hits_077.vortex 1.0 vortex-file-compressed 172.37 MB 172.44 MB +65.93 KB +0.0%
hits_075.vortex 1.0 vortex-file-compressed 189.50 MB 189.57 MB +69.69 KB +0.0%
hits_083.vortex 1.0 vortex-file-compressed 157.19 MB 157.24 MB +52.95 KB +0.0%
hits_086.vortex 1.0 vortex-file-compressed 192.10 MB 192.16 MB +63.76 KB +0.0%
hits_036.vortex 1.0 vortex-compact 133.39 MB 133.43 MB +40.17 KB +0.0%
hits_053.vortex 1.0 vortex-compact 138.39 MB 138.43 MB +41.08 KB +0.0%
hits_064.vortex 1.0 vortex-compact 140.05 MB 140.08 MB +34.45 KB +0.0%
hits_043.vortex 1.0 vortex-compact 94.31 MB 94.33 MB +19.71 KB +0.0%
hits_047.vortex 1.0 vortex-compact 110.49 MB 110.51 MB +21.43 KB +0.0%
hits_020.vortex 1.0 vortex-compact 111.65 MB 111.67 MB +21.39 KB +0.0%
hits_017.vortex 1.0 vortex-file-compressed 146.75 MB 146.77 MB +27.62 KB +0.0%
hits_039.vortex 1.0 vortex-compact 124.30 MB 124.32 MB +19.88 KB +0.0%
hits_036.vortex 1.0 vortex-file-compressed 171.35 MB 171.37 MB +22.77 KB +0.0%
hits_053.vortex 1.0 vortex-file-compressed 190.04 MB 190.07 MB +22.89 KB +0.0%
hits_056.vortex 1.0 vortex-compact 100.84 MB 100.85 MB +9.48 KB +0.0%
hits_065.vortex 1.0 vortex-file-compressed 161.30 MB 161.31 MB +10.47 KB +0.0%
hits_035.vortex 1.0 vortex-compact 75.96 MB 75.97 MB +4.81 KB +0.0%
hits_005.vortex 1.0 vortex-file-compressed 167.77 MB 167.78 MB +10.20 KB +0.0%
hits_038.vortex 1.0 vortex-file-compressed 190.17 MB 190.18 MB +11.55 KB +0.0%
hits_041.vortex 1.0 vortex-file-compressed 131.23 MB 131.24 MB +7.27 KB +0.0%
hits_084.vortex 1.0 vortex-compact 110.68 MB 110.69 MB +6.01 KB +0.0%
hits_076.vortex 1.0 vortex-file-compressed 161.01 MB 161.02 MB +8.71 KB +0.0%
hits_007.vortex 1.0 vortex-file-compressed 200.02 MB 200.03 MB +6.75 KB +0.0%
hits_010.vortex 1.0 vortex-compact 123.11 MB 123.11 MB +1.62 KB +0.0%
hits_027.vortex 1.0 vortex-compact 139.23 MB 139.23 MB +1.71 KB +0.0%
hits_094.vortex 1.0 vortex-compact 110.76 MB 110.76 MB +1.07 KB +0.0%
hits_032.vortex 1.0 vortex-compact 110.63 MB 110.64 MB +896 B +0.0%
hits_083.vortex 1.0 vortex-compact 110.04 MB 110.04 MB 240 B -0.0%
hits_071.vortex 1.0 vortex-compact 106.18 MB 106.18 MB 664 B -0.0%
hits_008.vortex 1.0 vortex-file-compressed 140.43 MB 140.43 MB 1.57 KB -0.0%
hits_077.vortex 1.0 vortex-compact 134.26 MB 134.26 MB 2.47 KB -0.0%
hits_072.vortex 1.0 vortex-compact 75.66 MB 75.66 MB 2.84 KB -0.0%
hits_085.vortex 1.0 vortex-compact 153.26 MB 153.26 MB 5.78 KB -0.0%
hits_019.vortex 1.0 vortex-compact 106.14 MB 106.14 MB 6.58 KB -0.0%
hits_069.vortex 1.0 vortex-file-compressed 142.30 MB 142.29 MB 13.75 KB -0.0%
hits_061.vortex 1.0 vortex-file-compressed 160.85 MB 160.83 MB 17.71 KB -0.0%
hits_087.vortex 1.0 vortex-file-compressed 160.96 MB 160.94 MB 19.27 KB -0.0%
hits_047.vortex 1.0 vortex-file-compressed 154.53 MB 154.50 MB 22.59 KB -0.0%
hits_066.vortex 1.0 vortex-compact 117.44 MB 117.42 MB 17.49 KB -0.0%
hits_019.vortex 1.0 vortex-file-compressed 140.92 MB 140.89 MB 23.15 KB -0.0%
hits_090.vortex 1.0 vortex-compact 141.33 MB 141.31 MB 26.27 KB -0.0%
hits_091.vortex 1.0 vortex-file-compressed 147.03 MB 147.00 MB 27.43 KB -0.0%
hits_000.vortex 1.0 vortex-file-compressed 131.57 MB 131.55 MB 24.88 KB -0.0%
hits_062.vortex 1.0 vortex-compact 132.66 MB 132.63 MB 25.43 KB -0.0%
hits_063.vortex 1.0 vortex-file-compressed 131.79 MB 131.76 MB 30.09 KB -0.0%
hits_066.vortex 1.0 vortex-file-compressed 163.63 MB 163.59 MB 42.16 KB -0.0%
hits_042.vortex 1.0 vortex-compact 136.29 MB 136.25 MB 36.28 KB -0.0%
hits_031.vortex 1.0 vortex-file-compressed 159.59 MB 159.55 MB 44.07 KB -0.0%
hits_021.vortex 1.0 vortex-file-compressed 154.35 MB 154.30 MB 44.42 KB -0.0%
hits_058.vortex 1.0 vortex-compact 111.10 MB 111.07 MB 32.03 KB -0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.41 MB 126.37 MB 40.90 KB -0.0%
hits_088.vortex 1.0 vortex-file-compressed 172.00 MB 171.94 MB 62.54 KB -0.0%
hits_055.vortex 1.0 vortex-compact 152.67 MB 152.62 MB 56.23 KB -0.0%
hits_092.vortex 1.0 vortex-file-compressed 199.56 MB 199.48 MB 85.36 KB -0.0%
hits_028.vortex 1.0 vortex-file-compressed 151.90 MB 151.84 MB 65.85 KB -0.0%
hits_021.vortex 1.0 vortex-compact 110.66 MB 110.62 MB 48.41 KB -0.0%
hits_029.vortex 1.0 vortex-file-compressed 199.87 MB 199.79 MB 89.62 KB -0.0%
hits_039.vortex 1.0 vortex-file-compressed 161.12 MB 161.05 MB 73.12 KB -0.0%
hits_073.vortex 1.0 vortex-file-compressed 172.73 MB 172.65 MB 82.24 KB -0.0%
hits_002.vortex 1.0 vortex-file-compressed 161.10 MB 161.00 MB 94.45 KB -0.1%
hits_054.vortex 1.0 vortex-compact 112.11 MB 112.05 MB 68.70 KB -0.1%
hits_089.vortex 1.0 vortex-file-compressed 131.64 MB 131.56 MB 81.06 KB -0.1%
hits_084.vortex 1.0 vortex-file-compressed 154.57 MB 154.48 MB 95.49 KB -0.1%
hits_046.vortex 1.0 vortex-compact 74.95 MB 74.90 MB 49.14 KB -0.1%
hits_076.vortex 1.0 vortex-compact 125.60 MB 125.52 MB 84.46 KB -0.1%
hits_045.vortex 1.0 vortex-file-compressed 140.15 MB 140.06 MB 94.64 KB -0.1%
hits_099.vortex 1.0 vortex-file-compressed 171.31 MB 171.19 MB 119.73 KB -0.1%
hits_023.vortex 1.0 vortex-compact 142.75 MB 142.65 MB 101.32 KB -0.1%
hits_059.vortex 1.0 vortex-file-compressed 199.07 MB 198.93 MB 141.84 KB -0.1%
hits_080.vortex 1.0 vortex-file-compressed 126.86 MB 126.77 MB 96.55 KB -0.1%
hits_030.vortex 1.0 vortex-file-compressed 132.05 MB 131.94 MB 105.67 KB -0.1%
hits_028.vortex 1.0 vortex-compact 115.74 MB 115.64 MB 101.95 KB -0.1%
hits_024.vortex 1.0 vortex-file-compressed 160.65 MB 160.50 MB 153.97 KB -0.1%
hits_068.vortex 1.0 vortex-compact 112.56 MB 112.46 MB 108.43 KB -0.1%
hits_074.vortex 1.0 vortex-file-compressed 199.38 MB 199.18 MB 202.87 KB -0.1%
hits_016.vortex 1.0 vortex-compact 127.42 MB 127.29 MB 130.68 KB -0.1%
hits_025.vortex 1.0 vortex-file-compressed 172.21 MB 172.04 MB 177.05 KB -0.1%
hits_055.vortex 1.0 vortex-file-compressed 199.73 MB 199.52 MB 209.99 KB -0.1%
hits_052.vortex 1.0 vortex-file-compressed 131.22 MB 131.08 MB 146.55 KB -0.1%
hits_004.vortex 1.0 vortex-file-compressed 131.53 MB 131.39 MB 147.77 KB -0.1%
hits_026.vortex 1.0 vortex-file-compressed 131.28 MB 131.13 MB 154.64 KB -0.1%
hits_048.vortex 1.0 vortex-compact 153.47 MB 153.29 MB 183.35 KB -0.1%
hits_003.vortex 1.0 vortex-compact 104.56 MB 104.43 MB 139.23 KB -0.1%
hits_007.vortex 1.0 vortex-compact 153.72 MB 153.51 MB 214.21 KB -0.1%
hits_045.vortex 1.0 vortex-compact 106.23 MB 106.08 MB 153.72 KB -0.1%
hits_088.vortex 1.0 vortex-compact 134.37 MB 134.15 MB 231.41 KB -0.2%
hits_014.vortex 1.0 vortex-compact 133.92 MB 133.69 MB 232.69 KB -0.2%
hits_059.vortex 1.0 vortex-compact 153.06 MB 152.80 MB 266.95 KB -0.2%
hits_067.vortex 1.0 vortex-file-compressed 132.19 MB 131.95 MB 236.59 KB -0.2%
hits_068.vortex 1.0 vortex-file-compressed 160.83 MB 160.54 MB 290.97 KB -0.2%
hits_081.vortex 1.0 vortex-compact 153.76 MB 153.48 MB 287.46 KB -0.2%
hits_078.vortex 1.0 vortex-file-compressed 131.01 MB 130.77 MB 248.05 KB -0.2%
hits_079.vortex 1.0 vortex-compact 128.09 MB 127.83 MB 258.93 KB -0.2%
hits_010.vortex 1.0 vortex-file-compressed 169.23 MB 168.89 MB 342.14 KB -0.2%
hits_080.vortex 1.0 vortex-compact 96.66 MB 96.46 MB 205.67 KB -0.2%
hits_062.vortex 1.0 vortex-file-compressed 171.22 MB 170.80 MB 427.23 KB -0.2%
hits_071.vortex 1.0 vortex-file-compressed 140.44 MB 140.09 MB 358.09 KB -0.2%
hits_018.vortex 1.0 vortex-file-compressed 199.73 MB 199.12 MB 627.48 KB -0.3%
hits_082.vortex 1.0 vortex-compact 106.11 MB 105.76 MB 354.48 KB -0.3%
hits_054.vortex 1.0 vortex-file-compressed 147.56 MB 147.03 MB 547.91 KB -0.4%
hits_069.vortex 1.0 vortex-compact 99.78 MB 99.42 MB 373.05 KB -0.4%
hits_089.vortex 1.0 vortex-compact 99.65 MB 99.25 MB 409.05 KB -0.4%
hits_081.vortex 1.0 vortex-file-compressed 199.99 MB 199.11 MB 901.09 KB -0.4%
hits_029.vortex 1.0 vortex-compact 153.45 MB 152.73 MB 731.91 KB -0.5%
hits_091.vortex 1.0 vortex-compact 112.20 MB 111.67 MB 545.46 KB -0.5%
hits_040.vortex 1.0 vortex-compact 110.52 MB 109.96 MB 566.41 KB -0.5%
hits_070.vortex 1.0 vortex-compact 153.79 MB 152.97 MB 834.36 KB -0.5%
hits_022.vortex 1.0 vortex-file-compressed 199.01 MB 197.83 MB 1.18 MB -0.6%
hits_070.vortex 1.0 vortex-file-compressed 200.04 MB 198.76 MB 1.28 MB -0.6%
hits_085.vortex 1.0 vortex-file-compressed 199.79 MB 198.48 MB 1.31 MB -0.7%
hits_015.vortex 1.0 vortex-compact 98.35 MB 97.69 MB 669.11 KB -0.7%
hits_004.vortex 1.0 vortex-compact 98.33 MB 97.54 MB 807.93 KB -0.8%
hits_086.vortex 1.0 vortex-compact 140.82 MB 139.57 MB 1.25 MB -0.9%
hits_075.vortex 1.0 vortex-compact 139.04 MB 137.73 MB 1.31 MB -0.9%
hits_065.vortex 1.0 vortex-compact 125.85 MB 124.64 MB 1.21 MB -1.0%
hits_001.vortex 1.0 vortex-compact 140.55 MB 138.98 MB 1.57 MB -1.1%
hits_024.vortex 1.0 vortex-compact 125.33 MB 123.91 MB 1.42 MB -1.1%
hits_001.vortex 1.0 vortex-file-compressed 195.33 MB 189.03 MB 6.30 MB -3.2%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 11.93 GB → 11.93 GB (+0.0%)
  • vortex-file-compressed: 15.96 GB → 15.96 GB (+0.0%)

@github-actions

github-actions Bot commented Jul 27, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (-1.0%, low confidence) · DuckDB No clear signal (-0.0%, low confidence)
Vortex (geomean): 0.995x ➖
Parquet (geomean): 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.995x ➖, 1↑ 2↓)
name PR 2d4d608 (ns) base b03f803 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 2547977 2827331 0.90
clickbench_q01/datafusion:vortex-file-compressed 🚨 21370553 19049187 1.12
clickbench_q02/datafusion:vortex-file-compressed 34567919 33892917 1.02
clickbench_q03/datafusion:vortex-file-compressed 37600055 37832437 0.99
clickbench_q04/datafusion:vortex-file-compressed 235801070 238442776 0.99
clickbench_q05/datafusion:vortex-file-compressed 310233701 297802693 1.04
clickbench_q06/datafusion:vortex-file-compressed 2538694 2373658 1.07
clickbench_q07/datafusion:vortex-file-compressed 🚀 22817336 28921275 0.79
clickbench_q08/datafusion:vortex-file-compressed 336460772 336629225 1.00
clickbench_q09/datafusion:vortex-file-compressed 458635189 451628394 1.02
clickbench_q10/datafusion:vortex-file-compressed 71883258 73832199 0.97
clickbench_q11/datafusion:vortex-file-compressed 84729245 86423199 0.98
clickbench_q12/datafusion:vortex-file-compressed 261253073 264258269 0.99
clickbench_q13/datafusion:vortex-file-compressed 409959570 410248222 1.00
clickbench_q14/datafusion:vortex-file-compressed 254723896 252722546 1.01
clickbench_q15/datafusion:vortex-file-compressed 283035591 276045605 1.03
clickbench_q16/datafusion:vortex-file-compressed 647004767 640495128 1.01
clickbench_q17/datafusion:vortex-file-compressed 639942672 637636866 1.00
clickbench_q18/datafusion:vortex-file-compressed 1343664519 1338230538 1.00
clickbench_q19/datafusion:vortex-file-compressed 🚨 29057081 26216638 1.11
clickbench_q20/datafusion:vortex-file-compressed 261678980 258416525 1.01
clickbench_q21/datafusion:vortex-file-compressed 359694483 349338312 1.03
clickbench_q22/datafusion:vortex-file-compressed 444886735 442776416 1.00
clickbench_q23/datafusion:vortex-file-compressed 554405840 606631412 0.91
clickbench_q24/datafusion:vortex-file-compressed 42949132 46383101 0.93
clickbench_q25/datafusion:vortex-file-compressed 73891271 71078778 1.04
clickbench_q26/datafusion:vortex-file-compressed 41623148 42740030 0.97
clickbench_q27/datafusion:vortex-file-compressed 376017089 375822692 1.00
clickbench_q28/datafusion:vortex-file-compressed 2318302540 2302892519 1.01
clickbench_q29/datafusion:vortex-file-compressed 54529079 55668265 0.98
clickbench_q30/datafusion:vortex-file-compressed 221664653 224558048 0.99
clickbench_q31/datafusion:vortex-file-compressed 244360850 239152523 1.02
clickbench_q32/datafusion:vortex-file-compressed 1037837002 1049870393 0.99
clickbench_q33/datafusion:vortex-file-compressed 1399748393 1378628108 1.02
clickbench_q34/datafusion:vortex-file-compressed 1366781723 1378033784 0.99
clickbench_q35/datafusion:vortex-file-compressed 238392896 238798110 1.00
clickbench_q36/datafusion:vortex-file-compressed 54487023 55391866 0.98
clickbench_q37/datafusion:vortex-file-compressed 24815941 25976255 0.96
clickbench_q38/datafusion:vortex-file-compressed 16194536 16175851 1.00
clickbench_q39/datafusion:vortex-file-compressed 122732292 127151429 0.97
clickbench_q40/datafusion:vortex-file-compressed 12425140 12782674 0.97
clickbench_q41/datafusion:vortex-file-compressed 12448398 12593792 0.99
clickbench_q42/datafusion:vortex-file-compressed 11923926 11462231 1.04
datafusion / parquet (1.005x ➖, 0↑ 1↓)
name PR 2d4d608 (ns) base b03f803 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 34624978 34796511 1.00
clickbench_q01/datafusion:parquet 53907884 52935663 1.02
clickbench_q02/datafusion:parquet 76252469 75750235 1.01
clickbench_q03/datafusion:parquet 68132956 67131969 1.01
clickbench_q04/datafusion:parquet 303185069 294811842 1.03
clickbench_q05/datafusion:parquet 359438882 337465826 1.07
clickbench_q06/datafusion:parquet 35170757 34762873 1.01
clickbench_q07/datafusion:parquet 55066915 55258470 1.00
clickbench_q08/datafusion:parquet 363460813 387952734 0.94
clickbench_q09/datafusion:parquet 523855034 503670901 1.04
clickbench_q10/datafusion:parquet 126193366 125477015 1.01
clickbench_q11/datafusion:parquet 150836238 151497831 1.00
clickbench_q12/datafusion:parquet 341279630 340248872 1.00
clickbench_q13/datafusion:parquet 492033451 504054573 0.98
clickbench_q14/datafusion:parquet 354289113 340713375 1.04
clickbench_q15/datafusion:parquet 306492443 306927384 1.00
clickbench_q16/datafusion:parquet 716675603 699351934 1.02
clickbench_q17/datafusion:parquet 682558775 671956307 1.02
clickbench_q18/datafusion:parquet 1425858548 1516969620 0.94
clickbench_q19/datafusion:parquet 69552183 77226204 0.90
clickbench_q20/datafusion:parquet 591202533 599863692 0.99
clickbench_q21/datafusion:parquet 655541814 646522947 1.01
clickbench_q22/datafusion:parquet 945525819 952166186 0.99
clickbench_q23/datafusion:parquet 4097394236 4107692765 1.00
clickbench_q24/datafusion:parquet 90726583 94363915 0.96
clickbench_q25/datafusion:parquet 171834273 164460344 1.04
clickbench_q26/datafusion:parquet 90913154 88922591 1.02
clickbench_q27/datafusion:parquet 679942376 692114442 0.98
clickbench_q28/datafusion:parquet 2500607874 2503138798 1.00
clickbench_q29/datafusion:parquet 🚨 100696644 89281402 1.13
clickbench_q30/datafusion:parquet 360993699 348308787 1.04
clickbench_q31/datafusion:parquet 384553589 380244529 1.01
clickbench_q32/datafusion:parquet 1172511740 1101268425 1.06
clickbench_q33/datafusion:parquet 1529614618 1512848238 1.01
clickbench_q34/datafusion:parquet 1526321219 1520035923 1.00
clickbench_q35/datafusion:parquet 285667699 279170396 1.02
clickbench_q36/datafusion:parquet 145275558 145783226 1.00
clickbench_q37/datafusion:parquet 80513174 81176178 0.99
clickbench_q38/datafusion:parquet 95014461 99290822 0.96
clickbench_q39/datafusion:parquet 248392387 246444538 1.01
clickbench_q40/datafusion:parquet 60116907 59644316 1.01
clickbench_q41/datafusion:parquet 57976374 57892341 1.00
clickbench_q42/datafusion:parquet 59407666 59546916 1.00
duckdb / vortex-file-compressed (0.995x ➖, 2↑ 1↓)
name PR 2d4d608 (ns) base b03f803 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 10043304 9267933 1.08
clickbench_q01/duckdb:vortex-file-compressed 15267837 15147767 1.01
clickbench_q02/duckdb:vortex-file-compressed 20645780 20339875 1.02
clickbench_q03/duckdb:vortex-file-compressed 27020904 26846643 1.01
clickbench_q04/duckdb:vortex-file-compressed 202179334 199576616 1.01
clickbench_q05/duckdb:vortex-file-compressed 185763945 182140097 1.02
clickbench_q06/duckdb:vortex-file-compressed 18809591 18314105 1.03
clickbench_q07/duckdb:vortex-file-compressed 20420414 19840130 1.03
clickbench_q08/duckdb:vortex-file-compressed 269349149 269515651 1.00
clickbench_q09/duckdb:vortex-file-compressed 351746701 350637432 1.00
clickbench_q10/duckdb:vortex-file-compressed 74190391 76375468 0.97
clickbench_q11/duckdb:vortex-file-compressed 84799515 83639846 1.01
clickbench_q12/duckdb:vortex-file-compressed 214864930 206091360 1.04
clickbench_q13/duckdb:vortex-file-compressed 420923049 415202005 1.01
clickbench_q14/duckdb:vortex-file-compressed 243983932 249147808 0.98
clickbench_q15/duckdb:vortex-file-compressed 255558637 254308693 1.00
clickbench_q16/duckdb:vortex-file-compressed 543295557 535927092 1.01
clickbench_q17/duckdb:vortex-file-compressed 436083525 435431158 1.00
clickbench_q18/duckdb:vortex-file-compressed 964487146 954257644 1.01
clickbench_q19/duckdb:vortex-file-compressed 20964904 21099424 0.99
clickbench_q20/duckdb:vortex-file-compressed 255171220 264732170 0.96
clickbench_q21/duckdb:vortex-file-compressed 334980228 344976020 0.97
clickbench_q22/duckdb:vortex-file-compressed 🚨 533334211 480079278 1.11
clickbench_q23/duckdb:vortex-file-compressed 🚀 129032931 181959881 0.71
clickbench_q24/duckdb:vortex-file-compressed 37461553 36282056 1.03
clickbench_q25/duckdb:vortex-file-compressed 82155634 83193444 0.99
clickbench_q26/duckdb:vortex-file-compressed 43990973 46786309 0.94
clickbench_q27/duckdb:vortex-file-compressed 222861131 215459962 1.03
clickbench_q28/duckdb:vortex-file-compressed 3023890641 3036768422 1.00
clickbench_q29/duckdb:vortex-file-compressed 26833648 25910195 1.04
clickbench_q30/duckdb:vortex-file-compressed 207522923 201065472 1.03
clickbench_q31/duckdb:vortex-file-compressed 294414569 294509389 1.00
clickbench_q32/duckdb:vortex-file-compressed 1133794388 1128892517 1.00
clickbench_q33/duckdb:vortex-file-compressed 1089520572 1112178481 0.98
clickbench_q34/duckdb:vortex-file-compressed 1192414711 1201534779 0.99
clickbench_q35/duckdb:vortex-file-compressed 373485855 377559036 0.99
clickbench_q36/duckdb:vortex-file-compressed 32926217 31694898 1.04
clickbench_q37/duckdb:vortex-file-compressed 22101015 23470197 0.94
clickbench_q38/duckdb:vortex-file-compressed 26131247 25924625 1.01
clickbench_q39/duckdb:vortex-file-compressed 47273496 45978526 1.03
clickbench_q40/duckdb:vortex-file-compressed 21990261 21750222 1.01
clickbench_q41/duckdb:vortex-file-compressed 21441782 23546406 0.91
clickbench_q42/duckdb:vortex-file-compressed 🚀 21017024 23354633 0.90
duckdb / parquet (1.000x ➖, 1↑ 0↓)
name PR 2d4d608 (ns) base b03f803 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 23724167 24084678 0.99
clickbench_q01/duckdb:parquet 31060371 31869805 0.97
clickbench_q02/duckdb:parquet 51899797 50596479 1.03
clickbench_q03/duckdb:parquet 41483780 41801109 0.99
clickbench_q04/duckdb:parquet 204441258 205445529 1.00
clickbench_q05/duckdb:parquet 263833581 261078714 1.01
clickbench_q06/duckdb:parquet 48267053 48542820 0.99
clickbench_q07/duckdb:parquet 32947646 32830808 1.00
clickbench_q08/duckdb:parquet 275516903 272805773 1.01
clickbench_q09/duckdb:parquet 403486337 399737371 1.01
clickbench_q10/duckdb:parquet 86208235 84588023 1.02
clickbench_q11/duckdb:parquet 103550972 102259684 1.01
clickbench_q12/duckdb:parquet 284788218 284609346 1.00
clickbench_q13/duckdb:parquet 486303804 472434011 1.03
clickbench_q14/duckdb:parquet 319901489 315412713 1.01
clickbench_q15/duckdb:parquet 257692963 262016929 0.98
clickbench_q16/duckdb:parquet 602590877 600605442 1.00
clickbench_q17/duckdb:parquet 506349980 505506481 1.00
clickbench_q18/duckdb:parquet 1038027205 1040406094 1.00
clickbench_q19/duckdb:parquet 30518256 28718849 1.06
clickbench_q20/duckdb:parquet 418875672 415526376 1.01
clickbench_q21/duckdb:parquet 535962827 535067154 1.00
clickbench_q22/duckdb:parquet 920122098 922869571 1.00
clickbench_q23/duckdb:parquet 267542343 265771520 1.01
clickbench_q24/duckdb:parquet 74062434 73109855 1.01
clickbench_q25/duckdb:parquet 164793453 164625053 1.00
clickbench_q26/duckdb:parquet 54462350 56371327 0.97
clickbench_q27/duckdb:parquet 478116656 476705653 1.00
clickbench_q28/duckdb:parquet 4767192649 4762262271 1.00
clickbench_q29/duckdb:parquet 43039173 43127973 1.00
clickbench_q30/duckdb:parquet 312048468 313895620 0.99
clickbench_q31/duckdb:parquet 381486035 376086102 1.01
clickbench_q32/duckdb:parquet 1125167474 1113818481 1.01
clickbench_q33/duckdb:parquet 1119225053 1105034135 1.01
clickbench_q34/duckdb:parquet 1164010350 1159985200 1.00
clickbench_q35/duckdb:parquet 375942501 370930491 1.01
clickbench_q36/duckdb:parquet 47831757 50121275 0.95
clickbench_q37/duckdb:parquet 34474889 35349716 0.98
clickbench_q38/duckdb:parquet 37717644 36089896 1.05
clickbench_q39/duckdb:parquet 🚀 84471353 95167570 0.89
clickbench_q40/duckdb:parquet 22131085 21751932 1.02
clickbench_q41/duckdb:parquet 20862644 20791294 1.00
clickbench_q42/duckdb:parquet 24432548 25064134 0.97
duckdb / duckdb (1.006x ➖, 1↑ 1↓)
name PR 2d4d608 (ns) base b03f803 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 19090251 18198993 1.05
clickbench_q01/duckdb:duckdb 36765986 35296232 1.04
clickbench_q02/duckdb:duckdb 53094297 52652133 1.01
clickbench_q03/duckdb:duckdb 58363442 56855821 1.03
clickbench_q04/duckdb:duckdb 211854538 215472093 0.98
clickbench_q05/duckdb:duckdb 282541892 282872891 1.00
clickbench_q06/duckdb:duckdb 36422563 35614192 1.02
clickbench_q07/duckdb:duckdb 36296135 36884198 0.98
clickbench_q08/duckdb:duckdb 277627761 278384033 1.00
clickbench_q09/duckdb:duckdb 393305486 396382718 0.99
clickbench_q10/duckdb:duckdb 116585468 116404198 1.00
clickbench_q11/duckdb:duckdb 127202490 125952021 1.01
clickbench_q12/duckdb:duckdb 259687228 262416117 0.99
clickbench_q13/duckdb:duckdb 444001715 443737648 1.00
clickbench_q14/duckdb:duckdb 287054969 285498446 1.01
clickbench_q15/duckdb:duckdb 243634855 243158945 1.00
clickbench_q16/duckdb:duckdb 571659575 566245826 1.01
clickbench_q17/duckdb:duckdb 475508054 472274365 1.01
clickbench_q18/duckdb:duckdb 994033539 1014623947 0.98
clickbench_q19/duckdb:duckdb 35718513 35077102 1.02
clickbench_q20/duckdb:duckdb 464568521 455996323 1.02
clickbench_q21/duckdb:duckdb 472376585 466415432 1.01
clickbench_q22/duckdb:duckdb 542772475 532141826 1.02
clickbench_q23/duckdb:duckdb 260407292 258144110 1.01
clickbench_q24/duckdb:duckdb 63468524 62848608 1.01
clickbench_q25/duckdb:duckdb 149143383 149815432 1.00
clickbench_q26/duckdb:duckdb 63873200 63614407 1.00
clickbench_q27/duckdb:duckdb 414452899 411761580 1.01
clickbench_q28/duckdb:duckdb 4432208965 4409942477 1.01
clickbench_q29/duckdb:duckdb 51904000 52023088 1.00
clickbench_q30/duckdb:duckdb 278691452 275889286 1.01
clickbench_q31/duckdb:duckdb 371764883 363172007 1.02
clickbench_q32/duckdb:duckdb 1121915157 1121572574 1.00
clickbench_q33/duckdb:duckdb 1128121622 1118930202 1.01
clickbench_q34/duckdb:duckdb 1206056380 1195998004 1.01
clickbench_q35/duckdb:duckdb 299423542 300700940 1.00
clickbench_q36/duckdb:duckdb 🚨 56435901 49419840 1.14
clickbench_q37/duckdb:duckdb 30118131 30026690 1.00
clickbench_q38/duckdb:duckdb 35865781 35038112 1.02
clickbench_q39/duckdb:duckdb 🚀 82094217 97929900 0.84
clickbench_q40/duckdb:duckdb 29420344 29024694 1.01
clickbench_q41/duckdb:duckdb 27851973 28145017 0.99
clickbench_q42/duckdb:duckdb 30581200 30442727 1.00
File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.11 GB → 7.11 GB (-0.0%)
  • vortex-file-compressed: 11.04 GB → 11.04 GB (0.0%)

@github-actions

github-actions Bot commented Jul 27, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -7.1%
Engines: DataFusion No clear signal (-13.9%, environment too noisy confidence) · DuckDB No clear signal (+0.3%, environment too noisy confidence)
Vortex (geomean): 0.975x ➖
Parquet (geomean): 1.049x ➖
Shifts: Parquet (control) +4.9% · Median polish -1.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.991x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 265503659 272689176 0.97
tpch_q02/datafusion:vortex-file-compressed 496441976 429242661 1.16
tpch_q03/datafusion:vortex-file-compressed 432722558 401938478 1.08
tpch_q04/datafusion:vortex-file-compressed 241275350 217408157 1.11
tpch_q05/datafusion:vortex-file-compressed 445316620 363868090 1.22
tpch_q06/datafusion:vortex-file-compressed 303364109 286947741 1.06
tpch_q07/datafusion:vortex-file-compressed 419505330 414410966 1.01
tpch_q08/datafusion:vortex-file-compressed 502713660 538327220 0.93
tpch_q09/datafusion:vortex-file-compressed 370890032 378068325 0.98
tpch_q10/datafusion:vortex-file-compressed 435115997 497197723 0.88
tpch_q11/datafusion:vortex-file-compressed 273143561 325068248 0.84
tpch_q12/datafusion:vortex-file-compressed 384283918 403809447 0.95
tpch_q13/datafusion:vortex-file-compressed 202836807 217679612 0.93
tpch_q14/datafusion:vortex-file-compressed 248431225 319539006 0.78
tpch_q15/datafusion:vortex-file-compressed 484066958 502117165 0.96
tpch_q16/datafusion:vortex-file-compressed 193962727 238862177 0.81
tpch_q17/datafusion:vortex-file-compressed 307459980 304929117 1.01
tpch_q18/datafusion:vortex-file-compressed 256447179 269343045 0.95
tpch_q19/datafusion:vortex-file-compressed 470000375 458443189 1.03
tpch_q20/datafusion:vortex-file-compressed 396193314 394975614 1.00
tpch_q21/datafusion:vortex-file-compressed 640177704 511504387 1.25
tpch_q22/datafusion:vortex-file-compressed 143488970 139576237 1.03
datafusion / vortex-compact (0.942x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 255456634 291615855 0.88
tpch_q02/datafusion:vortex-compact 428032511 414593138 1.03
tpch_q03/datafusion:vortex-compact 413698822 422554968 0.98
tpch_q04/datafusion:vortex-compact 260124846 260925457 1.00
tpch_q05/datafusion:vortex-compact 359554752 414677521 0.87
tpch_q06/datafusion:vortex-compact 300604085 361991468 0.83
tpch_q07/datafusion:vortex-compact 390103005 488847827 0.80
tpch_q08/datafusion:vortex-compact 465814764 495386323 0.94
tpch_q09/datafusion:vortex-compact 331169583 372043078 0.89
tpch_q10/datafusion:vortex-compact 397832461 426334693 0.93
tpch_q11/datafusion:vortex-compact 259165657 308400768 0.84
tpch_q12/datafusion:vortex-compact 362254665 428150350 0.85
tpch_q13/datafusion:vortex-compact 188189007 210190608 0.90
tpch_q14/datafusion:vortex-compact 235855596 275916210 0.85
tpch_q15/datafusion:vortex-compact 413451880 423708618 0.98
tpch_q16/datafusion:vortex-compact 184373600 193078221 0.95
tpch_q17/datafusion:vortex-compact 398909619 365003735 1.09
tpch_q18/datafusion:vortex-compact 307608043 284980332 1.08
tpch_q19/datafusion:vortex-compact 623431053 571528536 1.09
tpch_q20/datafusion:vortex-compact 455270727 457957390 0.99
tpch_q21/datafusion:vortex-compact 514749128 542865126 0.95
tpch_q22/datafusion:vortex-compact 178654181 160508492 1.11
datafusion / parquet (1.122x ➖, 0↑ 1↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 230552953 202996789 1.14
tpch_q02/datafusion:parquet 415439865 385294842 1.08
tpch_q03/datafusion:parquet 354244786 353354599 1.00
tpch_q04/datafusion:parquet 223125177 182013355 1.23
tpch_q05/datafusion:parquet 532246635 452050221 1.18
tpch_q06/datafusion:parquet 🚨 263252780 136465161 1.93
tpch_q07/datafusion:parquet 588781497 454520925 1.30
tpch_q08/datafusion:parquet 637215999 558580492 1.14
tpch_q09/datafusion:parquet 457917319 476531938 0.96
tpch_q10/datafusion:parquet 474833970 450319615 1.05
tpch_q11/datafusion:parquet 368026983 361685013 1.02
tpch_q12/datafusion:parquet 261785435 217463598 1.20
tpch_q13/datafusion:parquet 433219884 419396605 1.03
tpch_q14/datafusion:parquet 200036645 164314362 1.22
tpch_q15/datafusion:parquet 327049799 289217452 1.13
tpch_q16/datafusion:parquet 176395575 167533449 1.05
tpch_q17/datafusion:parquet 416238843 364662606 1.14
tpch_q18/datafusion:parquet 424970623 421392608 1.01
tpch_q19/datafusion:parquet 343248372 338532249 1.01
tpch_q20/datafusion:parquet 309791641 307688788 1.01
tpch_q21/datafusion:parquet 505667837 491315839 1.03
tpch_q22/datafusion:parquet 180065627 162726719 1.11
duckdb / vortex-file-compressed (0.960x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 263957089 242273893 1.09
tpch_q02/duckdb:vortex-file-compressed 935735365 928023370 1.01
tpch_q03/duckdb:vortex-file-compressed 637885788 610144457 1.05
tpch_q04/duckdb:vortex-file-compressed 395127957 356428166 1.11
tpch_q05/duckdb:vortex-file-compressed 751771161 826635740 0.91
tpch_q06/duckdb:vortex-file-compressed 314561303 343362536 0.92
tpch_q07/duckdb:vortex-file-compressed 825327792 837949196 0.98
tpch_q08/duckdb:vortex-file-compressed 1036013400 1022269728 1.01
tpch_q09/duckdb:vortex-file-compressed 835078089 910988745 0.92
tpch_q10/duckdb:vortex-file-compressed 674370252 658711207 1.02
tpch_q11/duckdb:vortex-file-compressed 435371045 482897352 0.90
tpch_q12/duckdb:vortex-file-compressed 646411811 647116420 1.00
tpch_q13/duckdb:vortex-file-compressed 412909361 524209111 0.79
tpch_q14/duckdb:vortex-file-compressed 377953584 457229292 0.83
tpch_q15/duckdb:vortex-file-compressed 297700584 257504582 1.16
tpch_q16/duckdb:vortex-file-compressed 334637385 336529357 0.99
tpch_q17/duckdb:vortex-file-compressed 633706905 758340805 0.84
tpch_q18/duckdb:vortex-file-compressed 519684826 572598028 0.91
tpch_q19/duckdb:vortex-file-compressed 460890850 457763521 1.01
tpch_q20/duckdb:vortex-file-compressed 728063409 752581610 0.97
tpch_q21/duckdb:vortex-file-compressed 958218354 1144680532 0.84
tpch_q22/duckdb:vortex-file-compressed 283659746 285422299 0.99
duckdb / vortex-compact (1.007x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 317969680 276824882 1.15
tpch_q02/duckdb:vortex-compact 884231201 888651123 1.00
tpch_q03/duckdb:vortex-compact 576049928 587146675 0.98
tpch_q04/duckdb:vortex-compact 337338427 336870981 1.00
tpch_q05/duckdb:vortex-compact 762939815 767913337 0.99
tpch_q06/duckdb:vortex-compact 314121097 311713507 1.01
tpch_q07/duckdb:vortex-compact 834895868 881181697 0.95
tpch_q08/duckdb:vortex-compact 967652297 1009299045 0.96
tpch_q09/duckdb:vortex-compact 890464543 930179957 0.96
tpch_q10/duckdb:vortex-compact 668405993 636596214 1.05
tpch_q11/duckdb:vortex-compact 463372910 471522296 0.98
tpch_q12/duckdb:vortex-compact 543580254 600772615 0.90
tpch_q13/duckdb:vortex-compact 360633544 322497439 1.12
tpch_q14/duckdb:vortex-compact 327967916 333437284 0.98
tpch_q15/duckdb:vortex-compact 312750816 250099702 1.25
tpch_q16/duckdb:vortex-compact 332056201 331336759 1.00
tpch_q17/duckdb:vortex-compact 616843180 591088715 1.04
tpch_q18/duckdb:vortex-compact 512105450 576288906 0.89
tpch_q19/duckdb:vortex-compact 434523695 450162355 0.97
tpch_q20/duckdb:vortex-compact 710482771 683369876 1.04
tpch_q21/duckdb:vortex-compact 988252026 988975309 1.00
tpch_q22/duckdb:vortex-compact 260426483 259639663 1.00
duckdb / parquet (0.981x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 396553332 390052019 1.02
tpch_q02/duckdb:parquet 1003550637 1036194685 0.97
tpch_q03/duckdb:parquet 959525348 940431225 1.02
tpch_q04/duckdb:parquet 597264406 588230786 1.02
tpch_q05/duckdb:parquet 1141481003 1248969153 0.91
tpch_q06/duckdb:parquet 387650203 387950061 1.00
tpch_q07/duckdb:parquet 1095895780 1133564602 0.97
tpch_q08/duckdb:parquet 1292068658 1381711515 0.94
tpch_q09/duckdb:parquet 1243977143 1276365193 0.97
tpch_q10/duckdb:parquet 1193151320 1194304821 1.00
tpch_q11/duckdb:parquet 643865830 682458040 0.94
tpch_q12/duckdb:parquet 672430275 612682389 1.10
tpch_q13/duckdb:parquet 852804737 904486675 0.94
tpch_q14/duckdb:parquet 610048691 637351029 0.96
tpch_q15/duckdb:parquet 499142062 453529012 1.10
tpch_q16/duckdb:parquet 614600999 680913379 0.90
tpch_q17/duckdb:parquet 742546481 717030342 1.04
tpch_q18/duckdb:parquet 839893673 817634638 1.03
tpch_q19/duckdb:parquet 671545121 721331061 0.93
tpch_q20/duckdb:parquet 1058544723 1061601389 1.00
tpch_q21/duckdb:parquet 1022510324 1026921960 1.00
tpch_q22/duckdb:parquet 506354012 576227166 0.88

@github-actions

github-actions Bot commented Jul 27, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): 1.059x ➖
Parquet (geomean): 1.052x ➖
Shifts: Parquet (control) +5.2% · Median polish +3.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.072x ➖, 0↑ 2↓)
name PR 2d4d608 (ns) base 9d2735a (ns) ratio (PR/base)
appian_q01/datafusion:vortex-file-compressed 128233469 118469804 1.08
appian_q02/datafusion:vortex-file-compressed 619024637 580096658 1.07
appian_q03/datafusion:vortex-file-compressed 🚨 367761770 331499290 1.11
appian_q04/datafusion:vortex-file-compressed 🚨 46379441006 42135603166 1.10
appian_q05/datafusion:vortex-file-compressed 258793991 251544704 1.03
appian_q06/datafusion:vortex-file-compressed 352092142 330821706 1.06
appian_q07/datafusion:vortex-file-compressed 432505117 414059696 1.04
appian_q08/datafusion:vortex-file-compressed 2052513277 1892452583 1.08
datafusion / parquet (1.070x ➖, 0↑ 1↓)
name PR 2d4d608 (ns) base 9d2735a (ns) ratio (PR/base)
appian_q01/datafusion:parquet 136839886 130517230 1.05
appian_q02/datafusion:parquet 634726266 601472786 1.06
appian_q03/datafusion:parquet 350698290 324975336 1.08
appian_q04/datafusion:parquet 🚨 46607306528 42201913932 1.10
appian_q05/datafusion:parquet 299185108 274606771 1.09
appian_q06/datafusion:parquet 369099136 347000827 1.06
appian_q07/datafusion:parquet 469536832 446377922 1.05
appian_q08/datafusion:parquet 2052327603 1925177267 1.07
duckdb / vortex-file-compressed (1.045x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 9d2735a (ns) ratio (PR/base)
appian_q01/duckdb:vortex-file-compressed 193150904 184879323 1.04
appian_q02/duckdb:vortex-file-compressed 623341076 604636814 1.03
appian_q03/duckdb:vortex-file-compressed 270767625 255628992 1.06
appian_q04/duckdb:vortex-file-compressed 1364430047 1323458523 1.03
appian_q05/duckdb:vortex-file-compressed 302231134 284674626 1.06
appian_q06/duckdb:vortex-file-compressed 823175847 799025711 1.03
appian_q07/duckdb:vortex-file-compressed 365695594 345111192 1.06
appian_q08/duckdb:vortex-file-compressed 1331682371 1274210968 1.05
duckdb / parquet (1.036x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 9d2735a (ns) ratio (PR/base)
appian_q01/duckdb:parquet 210900385 201093114 1.05
appian_q02/duckdb:parquet 620817493 604030675 1.03
appian_q03/duckdb:parquet 303353919 284607456 1.07
appian_q04/duckdb:parquet 1365087020 1329822225 1.03
appian_q05/duckdb:parquet 328837114 314650191 1.05
appian_q06/duckdb:parquet 806475206 794552885 1.02
appian_q07/duckdb:parquet 373552998 365776163 1.02
appian_q08/duckdb:parquet 1317643972 1272937974 1.04
duckdb / duckdb (1.038x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 9d2735a (ns) ratio (PR/base)
appian_q01/duckdb:duckdb 178962669 171625476 1.04
appian_q02/duckdb:duckdb 566524655 549729530 1.03
appian_q03/duckdb:duckdb 399503088 390687602 1.02
appian_q04/duckdb:duckdb 1342495518 1300423687 1.03
appian_q05/duckdb:duckdb 301630280 279497283 1.08
appian_q06/duckdb:duckdb 803350302 781667430 1.03
appian_q07/duckdb:duckdb 337672097 326466338 1.03
appian_q08/duckdb:duckdb 1262653762 1218644218 1.04
File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 271.91 MB → 271.65 MB (-0.1%)
  • vortex-file-compressed: 479.69 MB → 479.69 MB (0.0%)

@github-actions

github-actions Bot commented Jul 27, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access 📖

Vortex (geomean): 1.243x ❌
Parquet (geomean): 1.136x ❌

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (1.217x ❌, 0↑ 43↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 3048097 386615 7.88
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 🚨 1167797 1049504 1.11
random-access/feature-vectors/correlated/parquet-tokio-local-disk 🚨 9623137856 8362310924 1.15
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 🚨 9773862598 8436459307 1.16
random-access/feature-vectors/correlated/vortex-tokio-local-disk 🚨 3661383 3221491 1.14
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚨 3581723 2849316 1.26
random-access/feature-vectors/uniform/lance-tokio-local-disk 🚨 1404236 1167186 1.20
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 🚨 2437395 1911553 1.28
random-access/feature-vectors/uniform/parquet-tokio-local-disk 🚨 10113093434 8351171846 1.21
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 🚨 10174464918 8295857153 1.23
random-access/feature-vectors/uniform/vortex-tokio-local-disk 🚨 4345850 3755141 1.16
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 🚨 7323706 6051862 1.21
random-access/lance-tokio-local-disk 🚨 762394 679376 1.12
random-access/lance-tokio-local-disk-footer 🚨 1748364 1374832 1.27
random-access/nested-lists/correlated/lance-tokio-local-disk 245205 226851 1.08
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 613154 565087 1.09
random-access/nested-lists/correlated/parquet-tokio-local-disk 🚨 152414671 130945494 1.16
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 142925588 130883720 1.09
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚨 388018 339684 1.14
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚨 587516 453874 1.29
random-access/nested-lists/uniform/lance-tokio-local-disk 1138905 1038530 1.10
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 🚨 1568410 1361460 1.15
random-access/nested-lists/uniform/parquet-tokio-local-disk 141828311 131812208 1.08
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 142670033 130361155 1.09
random-access/nested-lists/uniform/vortex-tokio-local-disk 🚨 2438507 2014365 1.21
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 🚨 2620582 2149755 1.22
random-access/nested-structs/correlated/lance-tokio-local-disk 389938 367864 1.06
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 581793 542034 1.07
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚨 28108295 23643635 1.19
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚨 26536063 23111164 1.15
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚨 567106 446763 1.27
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚨 851980 644288 1.32
random-access/nested-structs/uniform/lance-tokio-local-disk 🚨 3039382 2628915 1.16
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 🚨 3261763 2742225 1.19
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚨 26853829 23763816 1.13
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚨 25898126 23222277 1.12
random-access/nested-structs/uniform/vortex-tokio-local-disk 🚨 1745127 1233072 1.42
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 🚨 2122175 1601830 1.32
random-access/parquet-tokio-local-disk 🚨 205243930 175600912 1.17
random-access/parquet-tokio-local-disk-footer 190560467 176290900 1.08
random-access/taxi/correlated/lance-tokio-local-disk 🚨 1151961 1004905 1.15
random-access/taxi/correlated/lance-tokio-local-disk-footer 🚨 2446977 1969660 1.24
random-access/taxi/correlated/parquet-tokio-local-disk 🚨 295527155 263825318 1.12
random-access/taxi/correlated/parquet-tokio-local-disk-footer 🚨 297596560 263988953 1.13
random-access/taxi/correlated/vortex-tokio-local-disk 🚨 1625913 1346482 1.21
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚨 2408438 1896325 1.27
random-access/taxi/uniform/lance-tokio-local-disk 11073220 10285771 1.08
random-access/taxi/uniform/lance-tokio-local-disk-footer 🚨 12434696 10597197 1.17
random-access/taxi/uniform/parquet-tokio-local-disk 🚨 308450453 275752485 1.12
random-access/taxi/uniform/parquet-tokio-local-disk-footer 305341546 281026728 1.09
random-access/taxi/uniform/vortex-tokio-local-disk 🚨 6033955 4421677 1.36
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚨 6166768 5436327 1.13
random-access/vortex-tokio-local-disk 🚨 877494 735790 1.19
random-access/vortex-tokio-local-disk-footer 🚨 1569611 1221338 1.29

@github-actions

github-actions Bot commented Jul 27, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.9%
Engines: DataFusion No clear signal (-4.9%, environment too noisy confidence) · DuckDB No clear signal (+3.2%, environment too noisy confidence)
Vortex (geomean): 0.984x ➖
Parquet (geomean): 0.993x ➖
Shifts: Parquet (control) -0.7% · Median polish -0.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.008x ➖, 0↑ 1↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 730151324 715325099 1.02
tpch_q02/datafusion:vortex-file-compressed 808337098 800542781 1.01
tpch_q03/datafusion:vortex-file-compressed 757433668 814340299 0.93
tpch_q04/datafusion:vortex-file-compressed 442729279 476621115 0.93
tpch_q05/datafusion:vortex-file-compressed 850529483 887030430 0.96
tpch_q06/datafusion:vortex-file-compressed 550215108 564408600 0.97
tpch_q07/datafusion:vortex-file-compressed 1020967605 887859000 1.15
tpch_q08/datafusion:vortex-file-compressed 1184914729 1199094005 0.99
tpch_q09/datafusion:vortex-file-compressed 1178162360 1285493639 0.92
tpch_q10/datafusion:vortex-file-compressed 899200061 926081133 0.97
tpch_q11/datafusion:vortex-file-compressed 472795480 479757395 0.99
tpch_q12/datafusion:vortex-file-compressed 868005133 711529097 1.22
tpch_q13/datafusion:vortex-file-compressed 451216757 434517357 1.04
tpch_q14/datafusion:vortex-file-compressed 600569323 516798055 1.16
tpch_q15/datafusion:vortex-file-compressed 979630181 1032408713 0.95
tpch_q16/datafusion:vortex-file-compressed 393012327 545412741 0.72
tpch_q17/datafusion:vortex-file-compressed 1210301751 1185072081 1.02
tpch_q18/datafusion:vortex-file-compressed 1175617731 1202336007 0.98
tpch_q19/datafusion:vortex-file-compressed 846740242 849621626 1.00
tpch_q20/datafusion:vortex-file-compressed 🚨 1053237710 782757692 1.35
tpch_q21/datafusion:vortex-file-compressed 1377744831 1283040584 1.07
tpch_q22/datafusion:vortex-file-compressed 354682788 361182952 0.98
datafusion / vortex-compact (0.887x ➖, 3↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 770272058 731496622 1.05
tpch_q02/datafusion:vortex-compact 650566727 882208713 0.74
tpch_q03/datafusion:vortex-compact 674271313 814042011 0.83
tpch_q04/datafusion:vortex-compact 400653475 435391301 0.92
tpch_q05/datafusion:vortex-compact 806125182 838713115 0.96
tpch_q06/datafusion:vortex-compact 539982627 516165395 1.05
tpch_q07/datafusion:vortex-compact 881559470 901678055 0.98
tpch_q08/datafusion:vortex-compact 1418878660 1151084133 1.23
tpch_q09/datafusion:vortex-compact 1199953436 1113016443 1.08
tpch_q10/datafusion:vortex-compact 870363910 811859230 1.07
tpch_q11/datafusion:vortex-compact 390387904 382637429 1.02
tpch_q12/datafusion:vortex-compact 685289922 763183558 0.90
tpch_q13/datafusion:vortex-compact 🚀 404361613 592489608 0.68
tpch_q14/datafusion:vortex-compact 🚀 463854603 693683898 0.67
tpch_q15/datafusion:vortex-compact 838213983 1114021925 0.75
tpch_q16/datafusion:vortex-compact 383422583 387127211 0.99
tpch_q17/datafusion:vortex-compact 1118633591 1286362150 0.87
tpch_q18/datafusion:vortex-compact 1149626562 1072621765 1.07
tpch_q19/datafusion:vortex-compact 923024310 871184586 1.06
tpch_q20/datafusion:vortex-compact 795326216 995582283 0.80
tpch_q21/datafusion:vortex-compact 1302558383 1539468565 0.85
tpch_q22/datafusion:vortex-compact 🚀 469690583 1143204793 0.41
datafusion / parquet (0.994x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 855324471 815163212 1.05
tpch_q02/datafusion:parquet 772586356 863502724 0.89
tpch_q03/datafusion:parquet 888983718 1101427586 0.81
tpch_q04/datafusion:parquet 447448170 503284741 0.89
tpch_q05/datafusion:parquet 1165513112 1212574324 0.96
tpch_q06/datafusion:parquet 552866841 526227753 1.05
tpch_q07/datafusion:parquet 1199365723 1225509542 0.98
tpch_q08/datafusion:parquet 1487032529 1528653878 0.97
tpch_q09/datafusion:parquet 1678660642 1714763247 0.98
tpch_q10/datafusion:parquet 2022040359 2131917996 0.95
tpch_q11/datafusion:parquet 515544797 509702372 1.01
tpch_q12/datafusion:parquet 650111086 660074360 0.98
tpch_q13/datafusion:parquet 704785542 682160911 1.03
tpch_q14/datafusion:parquet 759411598 783786017 0.97
tpch_q15/datafusion:parquet 1389477860 1296419270 1.07
tpch_q16/datafusion:parquet 365570402 411124733 0.89
tpch_q17/datafusion:parquet 1430914220 1344763120 1.06
tpch_q18/datafusion:parquet 1518018284 1505771642 1.01
tpch_q19/datafusion:parquet 945143934 945416210 1.00
tpch_q20/datafusion:parquet 1190902594 1095206104 1.09
tpch_q21/datafusion:parquet 1980172000 1614176064 1.23
tpch_q22/datafusion:parquet 737699293 693245160 1.06
duckdb / vortex-file-compressed (1.030x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 628424836 592736852 1.06
tpch_q02/duckdb:vortex-file-compressed 1094789611 1176600759 0.93
tpch_q03/duckdb:vortex-file-compressed 802767850 803093907 1.00
tpch_q04/duckdb:vortex-file-compressed 655531787 668028360 0.98
tpch_q05/duckdb:vortex-file-compressed 1138973915 1117453088 1.02
tpch_q06/duckdb:vortex-file-compressed 593121239 542656854 1.09
tpch_q07/duckdb:vortex-file-compressed 1106566012 1120612332 0.99
tpch_q08/duckdb:vortex-file-compressed 1420253719 1350878882 1.05
tpch_q09/duckdb:vortex-file-compressed 1593121831 1619321594 0.98
tpch_q10/duckdb:vortex-file-compressed 1350879621 1241639526 1.09
tpch_q11/duckdb:vortex-file-compressed 617053698 597447920 1.03
tpch_q12/duckdb:vortex-file-compressed 1207425162 1157086079 1.04
tpch_q13/duckdb:vortex-file-compressed 846254277 771740439 1.10
tpch_q14/duckdb:vortex-file-compressed 679859753 716607665 0.95
tpch_q15/duckdb:vortex-file-compressed 577702634 539102458 1.07
tpch_q16/duckdb:vortex-file-compressed 485801782 454938694 1.07
tpch_q17/duckdb:vortex-file-compressed 972475656 927363098 1.05
tpch_q18/duckdb:vortex-file-compressed 847595432 867021581 0.98
tpch_q19/duckdb:vortex-file-compressed 800643791 741505221 1.08
tpch_q20/duckdb:vortex-file-compressed 1223365160 1219277296 1.00
tpch_q21/duckdb:vortex-file-compressed 1906439743 1858399570 1.03
tpch_q22/duckdb:vortex-file-compressed 416836326 381758259 1.09
duckdb / vortex-compact (1.020x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 646705265 629771040 1.03
tpch_q02/duckdb:vortex-compact 1067327721 1088232707 0.98
tpch_q03/duckdb:vortex-compact 839842989 803137362 1.05
tpch_q04/duckdb:vortex-compact 634278084 598569227 1.06
tpch_q05/duckdb:vortex-compact 1257727520 1092434015 1.15
tpch_q06/duckdb:vortex-compact 557069647 540892798 1.03
tpch_q07/duckdb:vortex-compact 1162637701 1058082703 1.10
tpch_q08/duckdb:vortex-compact 1402623541 1323628775 1.06
tpch_q09/duckdb:vortex-compact 1539389210 1598170593 0.96
tpch_q10/duckdb:vortex-compact 1341251589 1231276183 1.09
tpch_q11/duckdb:vortex-compact 615684640 648785921 0.95
tpch_q12/duckdb:vortex-compact 1086639169 1044869125 1.04
tpch_q13/duckdb:vortex-compact 842572417 707696614 1.19
tpch_q14/duckdb:vortex-compact 673834614 660655371 1.02
tpch_q15/duckdb:vortex-compact 571510537 549519457 1.04
tpch_q16/duckdb:vortex-compact 382663013 427551622 0.90
tpch_q17/duckdb:vortex-compact 877027273 904378679 0.97
tpch_q18/duckdb:vortex-compact 848577803 833018830 1.02
tpch_q19/duckdb:vortex-compact 745153695 708288961 1.05
tpch_q20/duckdb:vortex-compact 1102060297 1155008299 0.95
tpch_q21/duckdb:vortex-compact 1756954759 1700866731 1.03
tpch_q22/duckdb:vortex-compact 350028359 421976011 0.83
duckdb / parquet (0.993x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base 3b5ccf9 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 755069794 763597395 0.99
tpch_q02/duckdb:parquet 1135151104 1164776247 0.97
tpch_q03/duckdb:parquet 1515534442 1546254123 0.98
tpch_q04/duckdb:parquet 870481668 935788782 0.93
tpch_q05/duckdb:parquet 1673410330 1734013929 0.97
tpch_q06/duckdb:parquet 651208698 740686058 0.88
tpch_q07/duckdb:parquet 1598815718 1679081783 0.95
tpch_q08/duckdb:parquet 2157938498 2026931193 1.06
tpch_q09/duckdb:parquet 2321929771 2413976883 0.96
tpch_q10/duckdb:parquet 2854257662 2803369203 1.02
tpch_q11/duckdb:parquet 788568050 811998085 0.97
tpch_q12/duckdb:parquet 1019434978 1010766620 1.01
tpch_q13/duckdb:parquet 1240247835 1140692163 1.09
tpch_q14/duckdb:parquet 1175664811 1188236863 0.99
tpch_q15/duckdb:parquet 889713480 810699375 1.10
tpch_q16/duckdb:parquet 763399883 788979818 0.97
tpch_q17/duckdb:parquet 1186361267 1196437853 0.99
tpch_q18/duckdb:parquet 1398867898 1273710266 1.10
tpch_q19/duckdb:parquet 1342509288 1335480997 1.01
tpch_q20/duckdb:parquet 1656280648 1738779457 0.95
tpch_q21/duckdb:parquet 1745335170 1694106375 1.03
tpch_q22/duckdb:parquet 979499044 1021043397 0.96

@github-actions

github-actions Bot commented Jul 27, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Compression 📖

Vortex (geomean): 0.995x ➖
Parquet (geomean): 0.992x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (0.989x ➖, 0↑ 0↓)
name PR 2d4d608 (ns) base b03f803 (ns) ratio (PR/base)
compress time/Arade 1056798063 1116799910 0.95
compress time/Bimbo 5564956843 5789420644 0.96
compress time/CMSprovider 2645192440 2682276718 0.99
compress time/Euro2016 414691453 422756638 0.98
compress time/Food 352193957 375007532 0.94
compress time/HashTags 832897018 839891620 0.99
compress time/TPC-H l_comment canonical 1182722562 1219962544 0.97
compress time/TPC-H l_comment chunked 1169576566 1226092865 0.95
compress time/taxi 563069709 583550740 0.96
compress time/wide table cols=100 chunks=1 rows=1000 11650048 11966493 0.97
compress time/wide table cols=100 chunks=50 rows=1000 12418992 12658912 0.98
compress time/wide table cols=1000 chunks=1 rows=1000 135741528 132771119 1.02
compress time/wide table cols=1000 chunks=50 rows=1000 138489234 140083282 0.99
compress time/wide table cols=10000 chunks=1 rows=1000 1552573884 1599332770 0.97
compress time/wide table cols=10000 chunks=50 rows=1000 1565728595 1582307860 0.99
decompress time/Arade 28711271 27146297 1.06
decompress time/Bimbo 92933597 92459604 1.01
decompress time/CMSprovider 79987812 78278255 1.02
decompress time/Euro2016 20449537 20220242 1.01
decompress time/Food 8536457 8635810 0.99
decompress time/HashTags 92495887 95321326 0.97
decompress time/TPC-H l_comment canonical 42131509 42077560 1.00
decompress time/TPC-H l_comment chunked 43528032 42071453 1.03
decompress time/taxi 15858052 16449978 0.96
decompress time/wide table cols=100 chunks=1 rows=1000 2347009 2553712 0.92
decompress time/wide table cols=100 chunks=50 rows=1000 2353510 2557749 0.92
decompress time/wide table cols=1000 chunks=1 rows=1000 22376568 24194275 0.92
decompress time/wide table cols=1000 chunks=50 rows=1000 21938981 24358529 0.90
decompress time/wide table cols=10000 chunks=1 rows=1000 240057436 261133695 0.92
decompress time/wide table cols=10000 chunks=50 rows=1000 254479929 245128973 1.04
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2605723787 2598017986 1.00
parquet_rs-zstd compress time/Bimbo 12633910929 12606245521 1.00
parquet_rs-zstd compress time/CMSprovider 6800604566 6920902203 0.98
parquet_rs-zstd compress time/Euro2016 1300800668 1311861503 0.99
parquet_rs-zstd compress time/Food 793665847 799799440 0.99
parquet_rs-zstd compress time/HashTags 2122278316 2181644191 0.97
parquet_rs-zstd compress time/TPC-H l_comment canonical 3143969077 3230404807 0.97
parquet_rs-zstd compress time/TPC-H l_comment chunked 3159317566 3209630102 0.98
parquet_rs-zstd compress time/taxi 1183600550 1190061890 0.99
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 5989077 6140593 0.98
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6072742 6306924 0.96
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 73331578 75360335 0.97
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 74455347 76466920 0.97
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 769642297 812212828 0.95
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 767103545 807206901 0.95
parquet_rs-zstd decompress time/Arade 617579583 623479338 0.99
parquet_rs-zstd decompress time/Bimbo 1686450400 1692527578 1.00
parquet_rs-zstd decompress time/CMSprovider 1688132635 1702615777 0.99
parquet_rs-zstd decompress time/Euro2016 376349777 375367388 1.00
parquet_rs-zstd decompress time/Food 195874557 198128578 0.99
parquet_rs-zstd decompress time/HashTags 626009332 637894369 0.98
parquet_rs-zstd decompress time/TPC-H l_comment canonical 590926635 594575179 0.99
parquet_rs-zstd decompress time/TPC-H l_comment chunked 585806130 591058492 0.99
parquet_rs-zstd decompress time/taxi 245452677 244921764 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2812073 2788243 1.01
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2827678 2873653 0.98
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 31902468 32103802 0.99
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 32873166 33349913 0.99
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 347054649 345780624 1.00
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 347828233 349243154 1.00
vortex-file-compressed size/Arade 145358060 145358060 1.00
vortex-file-compressed size/Bimbo 467257556 467257556 1.00
vortex-file-compressed size/CMSprovider 417789364 417789356 1.00
vortex-file-compressed size/Euro2016 162143796 162142844 1.00
vortex-file-compressed size/Food 41977096 41977096 1.00
vortex-file-compressed size/HashTags 184887972 184887916 1.00
vortex-file-compressed size/TPC-H l_comment canonical 172639744 172639744 1.00
vortex-file-compressed size/TPC-H l_comment chunked 172639744 172639744 1.00
vortex-file-compressed size/taxi 52296276 52296276 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 932512 932512 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 932512 932512 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9309712 9309712 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9309712 9309712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 93117712 93117712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 93117712 93117712 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.94
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.96
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.00
vortex:parquet-zstd ratio compress time/Euro2016 0 0 0.99
vortex:parquet-zstd ratio compress time/Food 0 0 0.95
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.02
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.00
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 0.97
vortex:parquet-zstd ratio compress time/taxi 0 0 0.97
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 1.00
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 2 2 1.02
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.05
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.02
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 2 1 1.02
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 2 1 1.04
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.07
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.01
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.03
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.01
vortex:parquet-zstd ratio decompress time/Food 0 0 1.00
vortex:parquet-zstd ratio decompress time/HashTags 0 0 0.99
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.01
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.04
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.96
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 0.91
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 0.94
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 0.93
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 0.91
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 0.92
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.04
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 1 1 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 1 1 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@connortsui20

connortsui20 commented Jul 27, 2026

Copy link
Copy Markdown
Member Author

im going to make a new PR thats better

@connortsui20
connortsui20 deleted the codex/improve-clarity-of-pr-description branch July 27, 2026 15:24
@connortsui20 connortsui20 mentioned this pull request Jul 27, 2026
Merged
connortsui20 added a commit that referenced this pull request Jul 27, 2026
@connortsui20
Centralize SQL benchmark matrices in bench-orchestrator (#9017)
b15394a 
## Rationale for this change

Closes: #4935

Revived from: #8801

SQL benchmark coverage was spread across large workflow JSON matrices
and difficult to audit.

## What changes are included in this PR?

Moves benchmark coverage into one typed Python catalog. `vx-bench matrix
<preset>` validates and renders it for GitHub Actions; the surrounding
modules only model, validate, and render the catalog.

The `pr`, `pr-full`, `develop`, and `nightly` outputs remain unchanged.

Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@chatgpt-codex-connector chatgpt-codex-connector[bot] chatgpt-codex-connector[bot] left review comments
@AdamGS AdamGS Awaiting requested review from AdamGS
@myrrc myrrc Awaiting requested review from myrrc
@0ax1 0ax1 Awaiting requested review from 0ax1

Assignees

No one assigned

Labels

changelog/ci

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Make benchmark targets consistent

1 participant

@connortsui20